-- Logs begin at Fri 2022-04-08 01:55:00 UTC, end at Fri 2022-04-08 03:10:49 UTC. -- Apr 08 02:34:11.868306 dv-cinder-837051-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 08 02:34:11.876542 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 08 02:34:11.879081 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 8 02:34:11 2022] *** Apr 08 02:34:11.879081 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 08 02:34:11.879081 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 08 02:34:11.879081 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: nodename: dv-cinder-837051-1-iscsi Apr 08 02:34:11.879081 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: machine: x86_64 Apr 08 02:34:11.879081 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: clock source: unix Apr 08 02:34:11.879081 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: pcre jit disabled Apr 08 02:34:11.879081 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: detected number of CPU cores: 4 Apr 08 02:34:11.879081 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: current working directory: / Apr 08 02:34:11.879081 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: detected binary path: /usr/bin/uwsgi-core Apr 08 02:34:11.879669 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: your processes number limit is 47680 Apr 08 02:34:11.879669 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: your memory page size is 4096 bytes Apr 08 02:34:11.879669 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: detected max file descriptor number: 2048 Apr 08 02:34:11.879669 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: lock engine: pthread robust mutexes Apr 08 02:34:11.879669 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: thunder lock: enabled Apr 08 02:34:11.879669 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 08 02:34:11.879669 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 08 02:34:11.923594 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: Python main interpreter initialized at 0x5590dbefe9c0 Apr 08 02:34:11.923594 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: python threads support enabled Apr 08 02:34:11.923594 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: your server socket listen backlog is limited to 100 connections Apr 08 02:34:11.923594 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: your mercy for graceful operations on workers is 90 seconds Apr 08 02:34:11.923962 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: mapped 403077 bytes (393 KB) for 2 cores Apr 08 02:34:11.924043 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: *** Operational MODE: preforking *** Apr 08 02:34:11.924269 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: *** uWSGI is running in multiple interpreter mode *** Apr 08 02:34:11.924269 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: spawned uWSGI master process (pid: 86541) Apr 08 02:34:11.924454 dv-cinder-837051-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 08 02:34:11.929665 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: spawned uWSGI worker 1 (pid: 86542, cores: 1) Apr 08 02:34:11.929665 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: spawned uWSGI worker 2 (pid: 86543, cores: 1) Apr 08 02:34:11.929665 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 08 02:34:16.017147 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 08 02:34:16.017906 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 08 02:34:16.017906 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 08 02:34:16.018224 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 08 02:34:16.018468 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 08 02:34:16.018556 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 08 02:34:16.018955 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 08 02:34:16.019037 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.019165 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.019253 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 08 02:34:16.019488 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.019591 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 08 02:34:16.019804 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 08 02:34:16.019899 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.020169 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.020256 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.020485 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.020576 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.020808 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.020893 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.021131 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.021217 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.021462 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.021553 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.021729 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.021827 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.022559 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.022700 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.022888 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837051-1-iscsi {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.023038 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.023374 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.023471 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.023641 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.023734 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.023987 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.024075 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.024321 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837051-1-iscsi {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.024416 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.024630 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.024714 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.024950 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.025034 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.025259 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.025350 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.025580 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.025763 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.025875 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.026224 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.026357 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.026523 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.026610 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.026835 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.027101 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.027241 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.027359 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.027529 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.027674 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.027815 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.027991 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.028107 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.028337 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.028420 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.028658 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.028750 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.028972 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.029055 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.029297 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.029381 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837051-1-iscsi {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.029613 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.029751 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.029940 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.030029 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.030253 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.030346 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.030577 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837051-1-iscsi {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.030661 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.030896 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.030980 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.031211 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.031307 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.031527 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.031612 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.031890 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.031996 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.032227 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.032313 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.032555 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.032645 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.032877 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.032975 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.033196 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.033281 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.033506 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.033602 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.033810 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.033901 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.034120 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.034205 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.034429 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.034529 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.034750 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.034837 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.035053 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.035142 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.035357 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.035458 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.035609 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.035701 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.035916 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.036024 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.036264 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.036356 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.036585 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.036670 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.036843 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.036935 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.037146 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.037232 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.037398 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.037487 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.038330 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.038506 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.038654 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.038845 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.038932 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.039148 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.039233 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.039460 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.039549 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.039772 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.039859 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.040105 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.040213 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.040414 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.040498 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.040722 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.040806 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.041029 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.041128 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.041335 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.041423 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.041640 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.041724 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.041949 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.042043 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.042256 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.042341 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.042571 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.042661 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.042885 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.042976 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.043209 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.043302 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.043517 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.043606 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.043826 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.043911 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.044191 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.044289 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.044490 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.044575 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.044800 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.044885 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.045120 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.045220 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.045441 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.045528 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.045749 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.045833 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.046055 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.046145 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.046364 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.046451 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.046679 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.046773 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.046986 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.047071 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.047293 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.047376 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.047545 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.047631 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.047849 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.047969 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.048176 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.048272 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.048479 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.048564 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.048783 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.048878 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.049089 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.049181 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.049396 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.049489 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.049696 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.049787 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.050002 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.050094 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.050307 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.050397 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.050606 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.050695 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.050911 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.051002 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.051216 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.051301 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.051520 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.051605 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.051822 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.051914 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.052152 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.052237 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.052456 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.052540 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.052765 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.052852 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.053360 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.053458 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.053665 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.053751 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.053968 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.054051 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.054291 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.054383 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.054597 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.054693 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.054903 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.055026 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.055208 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.055299 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.055515 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.055606 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.055834 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.055992 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.056166 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.056267 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.056472 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.056558 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.056792 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.056885 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.057096 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.057188 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.057403 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.057486 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.057718 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.057810 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.058020 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.058116 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.058308 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.058394 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.058625 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.058712 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.058923 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.059016 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.059227 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.059312 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.059530 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.059616 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.059834 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.059918 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.060160 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.060256 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.060462 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.060554 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.060765 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.060849 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.061067 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.061163 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.061362 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.061453 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.061663 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.061747 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.061968 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.062062 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.062268 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.062353 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.062582 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.062665 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.062887 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.062981 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.063192 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.063277 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.063500 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.063584 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.063805 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.063899 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.064160 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:34:16.064251 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.064495 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.064580 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.064827 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.064914 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.065159 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.065244 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.065474 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.065562 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.065786 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.065878 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.066101 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.066192 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.066430 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.066516 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.066744 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.066836 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.067056 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.067144 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.067368 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.067467 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.067682 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.067766 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.068025 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.068154 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.068340 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.068452 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.068663 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.068758 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.069001 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.069101 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.069325 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.069524 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.069640 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.069745 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.069955 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.070041 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.070279 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.070378 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.070594 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.070681 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.070905 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.070996 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.071232 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.071332 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.071555 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.071647 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.071867 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.071967 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.072217 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.072314 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.072543 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.072629 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.072857 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.072949 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.073170 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.073264 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.073481 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.073568 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.073793 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.073885 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.074107 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.074194 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.074417 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.074501 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.074737 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.074822 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.075051 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.075137 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.075360 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.075452 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.075672 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.075757 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.076006 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.076108 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.076320 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.076407 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.076637 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.076721 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.076952 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.077089 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.077267 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.077351 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.077581 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.077676 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.077900 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.077986 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.078215 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.078318 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.078525 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.078619 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.078838 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.078925 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.079145 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.079239 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.079452 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.079551 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.079758 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.079843 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.080090 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.080178 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.080397 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.080495 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.080709 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.080795 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.081023 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.081115 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.081331 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.081425 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.081653 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.081741 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.081959 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.082045 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.082277 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.082363 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.082589 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.082675 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.082895 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.082981 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.083205 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.083290 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.083517 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.083609 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.083824 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.083914 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.084166 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.084255 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.085092 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.085194 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.085337 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.085432 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.085630 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.085746 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.085933 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.086026 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.086239 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.086325 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.086554 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.086641 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.086861 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.086952 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.087172 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.087265 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.087484 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.087576 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.087796 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.087888 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.088134 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.088368 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.088460 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.088545 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.088759 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.088853 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.089075 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.089240 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.089384 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.089475 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.089709 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.089796 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.090034 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.090128 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.090346 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.090430 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.090650 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.090737 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.090960 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.091046 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.091265 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.091357 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.091570 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.091668 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.091874 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.092004 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.092209 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.092295 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.092516 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.092602 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.092825 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.092911 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.093129 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.093213 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.093434 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.093519 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.093737 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.093822 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.094042 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.094180 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.094348 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.094485 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.094652 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.094786 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.094956 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.095092 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.095261 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.095405 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.095566 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.095700 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.095874 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.095980 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.096208 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.096307 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.096543 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.096629 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.096853 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.096937 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.097174 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.097312 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.097486 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.097573 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.097792 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.097878 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.098099 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.098197 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.098417 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.098539 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.098719 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.098808 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.099028 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.099122 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.099340 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.099424 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.099646 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.099805 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.099989 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.100678 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.100867 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.101019 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.101160 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.101293 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.101434 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.101602 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.101738 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.101918 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.102054 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.102242 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.102400 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.102557 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.102692 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.102876 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.103018 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.103190 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.103338 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.103498 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.103633 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.103806 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.103975 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.104143 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.104291 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.104461 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.104596 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.104774 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.104910 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.105087 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.105232 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.105393 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.105528 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.105705 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.105835 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.106013 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.106149 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.106322 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.106456 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.106629 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.106763 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.106936 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.107076 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.107253 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.107411 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.107566 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.107695 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.107888 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.108053 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.108226 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.108381 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.108533 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.108670 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.108830 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.108964 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.109154 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.109287 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.109461 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.109605 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.109765 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.109899 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.110073 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.110208 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.110379 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.110522 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.110687 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.110828 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.110996 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.111131 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.111319 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.111462 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.111638 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.111779 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.111963 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.112097 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.112287 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.112444 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.112610 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.112745 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.112921 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.113056 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.113232 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.113366 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.113542 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.113676 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.113853 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.113989 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.114160 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.114295 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.114474 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.114614 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.114784 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.114924 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.115094 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.115228 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.115404 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.115538 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.115750 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.116062 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.116213 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.116352 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.116486 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.116629 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.116761 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.116901 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.117034 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.117165 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.117303 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.117445 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.117606 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.117745 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.117919 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.118239 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.118383 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.118592 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.118811 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.118973 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.119152 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.119239 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.119474 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.119559 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.119799 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.119894 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.120157 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.120245 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.120480 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.120566 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.120803 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.120889 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.121115 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.121202 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.121431 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.121523 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.121741 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.121834 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.122048 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.122134 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.122356 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.122438 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.122663 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.122747 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.122974 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.123059 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.123281 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.123373 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.123589 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.123681 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.123895 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.124023 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.124225 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.124310 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.124531 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.124625 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.124837 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.124923 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.125144 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.125236 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.125448 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.125540 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.125764 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.125853 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.126069 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.126170 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.126382 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.126466 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.126690 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.126775 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.126993 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.127086 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.127297 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.127382 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.127602 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.127686 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.127907 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.128025 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.128237 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.128323 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.128585 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.128678 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.128895 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.128988 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.129235 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.129321 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.129544 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.129634 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.129851 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.129937 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.130176 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.130269 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.130482 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.130568 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.130786 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.130882 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.131098 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.131184 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.131912 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.132024 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.132243 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.132339 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.132557 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.132655 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.132867 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.132954 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.133180 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.133266 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.133485 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.133578 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.133794 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.133887 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.134097 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.134189 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.134413 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.134501 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.134719 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.134804 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.135023 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.135108 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.135325 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.135461 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.135632 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.135717 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.135962 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.136102 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.136266 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.136358 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.136578 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.136662 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.136886 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.136973 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.137190 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.137275 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.137501 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.137587 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.137807 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.137904 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.138113 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.138199 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.138418 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.138502 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.138727 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.138821 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.139042 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.139131 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.139344 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.139436 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.139657 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.139752 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.139984 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.140070 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.140294 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.140379 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.140597 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.140690 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.140905 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.140991 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.141207 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.141292 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.141511 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.141605 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.141813 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.141897 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.142115 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.142199 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.142415 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.142500 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.142720 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.142808 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.143023 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.143122 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.143335 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.143422 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.143640 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.143725 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.144029 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.144119 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.144269 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.144356 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.144573 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.144659 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.144917 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.145005 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.145226 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.145313 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.145543 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.145627 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.145866 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.145952 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.146181 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.146267 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.146494 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.146580 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.146805 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.146899 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.147192 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.147347 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.147586 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.147810 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.148016 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.148343 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.148430 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.148655 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.148959 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.149046 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.150306 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.150429 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.150524 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.150524 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.151570 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.151673 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.151756 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.151853 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.151959 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.152043 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.152123 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.152202 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.152202 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.152370 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.152452 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.152452 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.152593 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.152684 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.152776 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.152913 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.153002 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.153175 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.153270 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.153577 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.153770 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.153983 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.154153 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.154286 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.154490 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.154651 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.154799 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.154927 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.155096 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.155219 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.155393 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.155518 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.155719 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.155842 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.156051 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.156175 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.156354 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.156495 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.156660 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.156796 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.156966 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.157090 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.157280 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.157413 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.157587 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.157710 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.157948 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.158087 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.158266 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.158402 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.158579 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.158713 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.158908 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.159029 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.159215 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.159348 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.159517 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.159642 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.159834 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.159980 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.160189 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.160311 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.160499 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.160622 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.160808 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.160958 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.161225 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.161347 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.161540 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.161673 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.161856 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.161976 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.162161 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.162284 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.162469 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.163152 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.163305 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.163992 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.164162 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.164293 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.164293 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.164528 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.164652 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.164777 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.164913 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.165034 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.165158 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.165283 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.165406 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.165541 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.165666 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.165808 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.165938 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.166060 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.166194 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.166327 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.166509 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.166631 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.166866 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.167001 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.167171 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.167310 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.167486 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.167607 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.167795 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.167915 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.168152 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.168303 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.168459 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.168581 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.168781 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.168901 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.169100 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.169247 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.169423 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.169607 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.169761 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.169911 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.170072 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.170231 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.170384 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.170535 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.170684 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.170835 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.170992 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.171144 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.171294 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.171460 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.171622 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.171781 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.171967 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.172090 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.172231 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.172351 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.172633 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.172769 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.172961 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.173083 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.173278 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.173402 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.173581 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.173714 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.173906 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.174029 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.174216 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.174338 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.174524 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.174725 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.174856 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.174977 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.175135 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.175256 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.175442 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.175577 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.175766 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.175891 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.176096 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.176220 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.176413 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.176555 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.176728 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.176852 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.177040 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.177168 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.177348 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.177471 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.177656 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.177789 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.177979 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.179469 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.179659 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.179782 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.179908 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.180064 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.180202 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.180322 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.180457 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.180577 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.180699 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.180822 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.180945 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.181072 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.181212 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.181333 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.181455 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.181577 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.181742 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.181875 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.182053 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.182174 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.182365 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.182487 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.182711 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.182848 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.183022 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.183146 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.183355 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.183479 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.183700 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.183847 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.184028 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.184167 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.184357 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.184479 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.184674 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.184809 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.184984 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.185105 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.185293 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.185448 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.185603 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.185725 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.185939 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.186137 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.186256 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.186379 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.186541 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.186679 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.186864 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.187023 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.187169 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.187294 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.187477 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.187600 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.187786 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.187909 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.188124 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.188249 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.188434 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.188557 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.188743 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.188867 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.189053 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.189227 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.189374 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.189526 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.189666 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.189793 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.189990 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.190131 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.190297 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.190419 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.190604 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.190735 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.190911 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.191034 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.191214 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.191336 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.191523 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.191646 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.191834 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.191979 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.192168 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.192313 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.192495 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.192618 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.192805 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.192929 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.193131 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.193266 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.193447 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.193570 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.193761 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.193947 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.194548 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.194689 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.194813 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.194937 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.195061 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.195263 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.195384 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.195528 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.195649 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.195772 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.195905 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.196084 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.196224 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.196355 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.196477 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.196599 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.196788 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.196911 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.197101 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.197222 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.197410 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.197533 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.197744 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.197945 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.198086 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.198275 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.198398 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.198594 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.198717 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.198910 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.199045 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.199230 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.199376 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.199548 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.199683 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.199869 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.200060 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.200219 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.200343 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.200533 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.200657 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.200847 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.201067 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.201200 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.201403 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.201533 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.201726 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.201867 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.202050 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.202175 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.202372 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.202494 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.202698 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.202834 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.203019 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.203143 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.203339 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.203464 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.203656 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.203779 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.203992 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.204135 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.204312 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.204447 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.204642 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.204766 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.204967 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.205089 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.205292 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.205433 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.205616 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.205741 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.205935 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.206068 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.206252 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.206390 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.206566 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.206689 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.206886 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.207010 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.207236 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.207406 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.207569 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.207721 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.207872 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.208051 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.208211 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.208363 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.208514 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.208664 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.208815 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.208966 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.209134 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.209296 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.209574 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.210230 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.210230 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.210540 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.210702 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.210861 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.211014 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.211164 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.211323 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.211484 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.211655 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.211655 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.211994 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.212163 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.212315 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.212315 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.212622 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.212776 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.212935 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.213089 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.213248 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.213248 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.213547 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.213711 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.213862 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.213862 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.214204 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.214360 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.214515 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.214677 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.214830 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.214988 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.215152 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.215307 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.215460 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.215615 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.215779 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.215959 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.216190 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.216347 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.216347 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.216636 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.216636 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.216933 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.217093 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.217270 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.217434 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.217585 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.217748 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.217901 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.218062 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.218228 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.218429 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.218608 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.218762 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.218923 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.219075 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.219236 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.219397 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.219585 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.219741 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.219914 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.220132 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.220306 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.220463 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.220633 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.220789 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.220952 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.220952 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.221246 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.221407 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.221561 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.221715 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.221884 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.222047 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.222201 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.222360 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.222515 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.222678 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.222831 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.222985 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.223139 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.223292 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.223445 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.223613 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.223767 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.223920 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.224131 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.224316 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.224470 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.224640 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.224792 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.224953 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.225648 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.226207 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.226342 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.226342 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.226610 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.226745 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.226878 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.227021 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.227155 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.227300 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.227450 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.227581 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.227710 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.227838 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.227999 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.228131 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.228265 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.228397 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.228529 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.228677 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.228830 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.228981 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.229078 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.229078 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.229362 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.229495 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.229643 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.229772 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.229901 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.230034 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.230166 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.230253 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.230407 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.230541 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.230674 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.230807 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.230937 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.231064 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.231203 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.231331 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.231458 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.231458 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.231699 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.231835 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.231983 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.232130 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.232264 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.232396 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.232537 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.232733 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.232862 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.233002 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.233129 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.233262 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.233394 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.233533 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.233667 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.233797 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.233940 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.234074 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.234248 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.234567 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.234696 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.234884 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.235014 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.235199 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.235338 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.235516 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.235647 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.235831 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.236011 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.236176 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.236317 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.236492 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.236647 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.236806 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.236937 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.237122 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.237260 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.237437 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.237571 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.237751 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.237836 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.238068 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.238154 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.238390 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.238475 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.238706 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.238794 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.239022 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.239115 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.239338 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.239431 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.239655 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.239777 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.239991 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.240092 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.240312 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.240436 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.240626 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.241353 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.241933 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.242027 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.242107 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.242194 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.242273 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.242359 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.242471 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.242622 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.242796 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.242934 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.243118 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.243361 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.243458 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.243680 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.243766 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.244032 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.244133 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.244362 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.244449 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.244679 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.244772 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.245001 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.245085 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.245336 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.245424 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.245659 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.245752 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.245971 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.246112 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.246283 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.246378 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.246593 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.246701 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.246903 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.247027 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.247216 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.247355 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.247561 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.247655 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.247898 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.248018 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.248242 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.248358 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.248568 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.248694 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.248904 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.249027 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.249228 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.249341 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.249544 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.249652 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.249861 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.249948 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.250178 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.250270 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.250495 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.250601 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.250820 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.250943 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.251145 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.251267 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.251471 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.251595 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.251787 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.251952 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.252142 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.252275 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.252459 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.252593 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.252785 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.252912 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.253094 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.253228 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.253421 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.253544 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.253737 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.253870 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.254059 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.254194 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.254396 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.254532 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.254714 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.254803 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.255042 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.255162 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.255356 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.255451 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.255684 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.255770 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.256025 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.256114 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.256374 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.256901 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.256901 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.257059 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.257144 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.257223 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.257309 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.257386 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.257626 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.257762 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.257941 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.258029 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.258256 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.258343 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.258570 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.258655 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.258881 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.258972 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.259194 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.259280 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.259506 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.259591 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.259829 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.259920 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.260173 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.260263 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.260481 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.260566 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.260810 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.260904 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.261126 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.261210 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.261447 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.261541 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.261763 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.261856 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.262079 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.262166 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.262395 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.262490 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.262710 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.262803 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.263028 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.263113 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.263342 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.263426 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.263654 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.263747 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.263998 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.264089 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.264319 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.264406 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.264641 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.264733 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.264960 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.265045 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.265283 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.265366 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.265597 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.265683 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.265920 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.266006 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.266238 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.266330 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.266557 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.266688 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.266880 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.266965 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.267131 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=86543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 08 02:34:16.267266 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.267520 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.267849 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.268211 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.268543 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.268893 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.269211 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.269558 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.269890 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:34:16.270135 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=86542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 08 02:34:16.299940 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_db.sqlalchemy.engines [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:34:16.302734 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG oslo_db.sqlalchemy.engines [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:34:16.545305 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.context [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e0d9f6c4-1da5-4232-a6ea-53cb1efa9180(cell1) {{(pid=86543) load_cells /opt/stack/nova/nova/context.py:464}} Apr 08 02:34:16.547638 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.context [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e0d9f6c4-1da5-4232-a6ea-53cb1efa9180(cell1) {{(pid=86542) load_cells /opt/stack/nova/nova/context.py:464}} Apr 08 02:34:16.549465 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:34:16.551094 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:34:16.551843 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG oslo_concurrency.lockutils [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:34:16.551954 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:34:16.553777 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG oslo_concurrency.lockutils [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=86542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:34:16.554339 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:34:16.554669 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG oslo_concurrency.lockutils [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:34:16.556654 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG oslo_concurrency.lockutils [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=86542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:34:16.586943 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_db.sqlalchemy.engines [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:34:16.587784 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_db.sqlalchemy.engines [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:34:16.590002 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG oslo_db.sqlalchemy.engines [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:34:16.590796 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG oslo_db.sqlalchemy.engines [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:34:16.620350 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_db.sqlalchemy.engines [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:34:16.621669 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG oslo_db.sqlalchemy.engines [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:34:16.786972 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO keyring.backend [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] Loading KWallet Apr 08 02:34:16.788060 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO keyring.backend [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] Loading KWallet Apr 08 02:34:16.891039 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO keyring.backend [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] Loading SecretService Apr 08 02:34:16.891254 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO keyring.backend [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] Loading SecretService Apr 08 02:34:16.894527 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 02:34:16.894527 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: from cryptography.utils import int_from_bytes Apr 08 02:34:16.894709 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 02:34:16.894709 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: from cryptography.utils import int_from_bytes Apr 08 02:34:16.894842 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 02:34:16.894842 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: from cryptography.utils import int_from_bytes Apr 08 02:34:16.894956 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 02:34:16.894956 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: from cryptography.utils import int_from_bytes Apr 08 02:34:16.895543 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO keyring.backend [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] Loading Windows Apr 08 02:34:16.895643 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO keyring.backend [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] Loading Windows Apr 08 02:34:16.897523 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO keyring.backend [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] Loading chainer Apr 08 02:34:16.897644 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO keyring.backend [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] Loading chainer Apr 08 02:34:16.898321 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO keyring.backend [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] Loading macOS Apr 08 02:34:16.898411 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO keyring.backend [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] Loading macOS Apr 08 02:34:17.148669 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: WARNING keystonemiddleware.auth_token [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 02:34:17.151011 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: WARNING keystonemiddleware.auth_token [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 02:34:17.155202 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: WARNING keystonemiddleware.auth_token [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 02:34:17.157657 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: WARNING keystonemiddleware.auth_token [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 02:34:17.364890 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: WARNING keystonemiddleware.auth_token [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 02:34:17.369957 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: WARNING keystonemiddleware.auth_token [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 02:34:17.370555 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: WARNING keystonemiddleware.auth_token [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 02:34:17.375050 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: WARNING keystonemiddleware.auth_token [None req-460db897-3259-4611-a666-c7d82b56cd61 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 02:34:17.376646 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5590dbefe9c0 pid: 86542 (default app) Apr 08 02:34:17.378694 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:34:17.379790 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001622 Apr 08 02:34:17.380238 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Fri Apr 8 02:34:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:34:17.381191 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5590dbefe9c0 pid: 86543 (default app) Apr 08 02:35:37.785773 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:35:37.786983 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001651 Apr 08 02:35:37.787396 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 930 bytes} [Fri Apr 8 02:35:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:35:38.342589 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-1e087313-e069-4e8c-8c79-76033047edf5 admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:35:38.369223 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-1e087313-e069-4e8c-8c79-76033047edf5 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.574988 Apr 08 02:35:38.369774 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1291 bytes} [Fri Apr 8 02:35:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:35:40.521429 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:35:40.522413 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-c4b231f7-aaa3-4658-9953-1f57262b866c None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Apr 08 02:35:40.522819 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 930 bytes} [Fri Apr 8 02:35:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:35:40.578959 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-04fa648a-5585-4ad1-85f3-cf847f8415aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "ram": 256, "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:35:40.597146 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:35:40.597146 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: warnings.warn(msg) Apr 08 02:35:40.624344 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-04fa648a-5585-4ad1-85f3-cf847f8415aa admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.095520 Apr 08 02:35:40.625810 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Apr 8 02:35:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:35:40.957482 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-cc36823a-510f-459b-afba-88069b10ed08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:35:40.959820 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:35:40.959820 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: warnings.warn(msg) Apr 08 02:35:41.001353 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-cc36823a-510f-459b-afba-88069b10ed08 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.363637 Apr 08 02:35:41.001924 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1335 bytes} [Fri Apr 8 02:35:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:35:43.155503 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-04fa648a-5585-4ad1-85f3-cf847f8415aa admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:35:43.156543 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-04fa648a-5585-4ad1-85f3-cf847f8415aa admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Apr 08 02:35:43.156939 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 930 bytes} [Fri Apr 8 02:35:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:35:43.262483 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-619d62b9-ddad-4f89-91f6-b3f7a6eb8b8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "d1", "rxtx_factor": 1.0, "ram": 512, "disk": 5, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:35:43.280527 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:35:43.280527 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: warnings.warn(msg) Apr 08 02:35:43.304447 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-619d62b9-ddad-4f89-91f6-b3f7a6eb8b8f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141228 Apr 08 02:35:43.304997 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Apr 8 02:35:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 02:35:43.316462 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-fdf6a8e7-11b1-4dcc-8ce4-a4de0002b01e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:35:43.318491 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:35:43.318491 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: warnings.warn(msg) Apr 08 02:35:43.353434 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-fdf6a8e7-11b1-4dcc-8ce4-a4de0002b01e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040535 Apr 08 02:35:43.353938 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1335 bytes} [Fri Apr 8 02:35:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:35:45.530088 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-619d62b9-ddad-4f89-91f6-b3f7a6eb8b8f admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:35:45.531082 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-619d62b9-ddad-4f89-91f6-b3f7a6eb8b8f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Apr 08 02:35:45.531489 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 930 bytes} [Fri Apr 8 02:35:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:35:45.587026 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-d2000a67-5f99-45aa-b45b-9f67c22d3ff3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:35:45.610551 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-d2000a67-5f99-45aa-b45b-9f67c22d3ff3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073148 Apr 08 02:35:45.611095 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Apr 8 02:35:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 02:35:45.622767 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-440d559e-fae2-4eab-94e7-7905e2f51ad6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:35:45.658362 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-440d559e-fae2-4eab-94e7-7905e2f51ad6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039239 Apr 08 02:35:45.658911 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1335 bytes} [Fri Apr 8 02:35:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:35:47.815920 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-d2000a67-5f99-45aa-b45b-9f67c22d3ff3 admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:35:47.817527 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-d2000a67-5f99-45aa-b45b-9f67c22d3ff3 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Apr 08 02:35:47.817972 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 930 bytes} [Fri Apr 8 02:35:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:35:47.873105 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-568d835a-68a7-422f-b7e3-d1bdfe006bbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "vcpus": 2, "swap": 0}} {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:35:47.897684 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-568d835a-68a7-422f-b7e3-d1bdfe006bbc admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073864 Apr 08 02:35:47.898257 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Apr 8 02:35:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 02:35:47.909820 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-edb93b6c-af03-4a8b-8d41-63289d40254d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:35:47.947105 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-edb93b6c-af03-4a8b-8d41-63289d40254d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040993 Apr 08 02:35:47.947675 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1335 bytes} [Fri Apr 8 02:35:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:35:50.131417 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-568d835a-68a7-422f-b7e3-d1bdfe006bbc admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:35:50.132459 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-568d835a-68a7-422f-b7e3-d1bdfe006bbc admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Apr 08 02:35:50.132858 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 930 bytes} [Fri Apr 8 02:35:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:35:50.189498 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-bf3a8b34-d38b-4719-94e9-ca322cf3b6ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096}} {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:35:50.213346 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-bf3a8b34-d38b-4719-94e9-ca322cf3b6ee admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074814 Apr 08 02:35:50.213885 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Apr 8 02:35:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 02:35:50.225556 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-9b621f8b-fd64-42a6-a2ac-c8919975541a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:35:50.260030 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-9b621f8b-fd64-42a6-a2ac-c8919975541a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038252 Apr 08 02:35:50.260568 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1335 bytes} [Fri Apr 8 02:35:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:35:52.415653 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-bf3a8b34-d38b-4719-94e9-ca322cf3b6ee admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:35:52.416670 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-bf3a8b34-d38b-4719-94e9-ca322cf3b6ee admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Apr 08 02:35:52.417079 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 930 bytes} [Fri Apr 8 02:35:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:35:52.473390 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-0b1b3e91-ed2f-4836-96b3-02d462e8d8f7 admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:35:52.493978 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-0b1b3e91-ed2f-4836-96b3-02d462e8d8f7 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.070931 Apr 08 02:35:52.494502 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1291 bytes} [Fri Apr 8 02:35:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:35:54.646951 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-bf3a8b34-d38b-4719-94e9-ca322cf3b6ee admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:35:54.647978 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-bf3a8b34-d38b-4719-94e9-ca322cf3b6ee admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Apr 08 02:35:54.648388 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 930 bytes} [Fri Apr 8 02:35:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:35:54.704039 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-2f50d4c6-58d6-43a9-b0d0-89d674ebafcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1", "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:35:54.729303 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-2f50d4c6-58d6-43a9-b0d0-89d674ebafcc admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074972 Apr 08 02:35:54.729827 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Apr 8 02:35:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 02:35:54.741283 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-0211f027-51d6-40a2-8f6f-330c363b64e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:35:54.776972 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-0211f027-51d6-40a2-8f6f-330c363b64e3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039336 Apr 08 02:35:54.777466 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1332 bytes} [Fri Apr 8 02:35:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:35:56.904521 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-2f50d4c6-58d6-43a9-b0d0-89d674ebafcc admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:35:56.905560 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-2f50d4c6-58d6-43a9-b0d0-89d674ebafcc admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Apr 08 02:35:56.905959 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 930 bytes} [Fri Apr 8 02:35:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:35:56.962216 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-81cfaac8-846e-4150-853f-d388f421f61b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "id": "2", "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:35:56.985666 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-81cfaac8-846e-4150-853f-d388f421f61b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073417 Apr 08 02:35:56.986220 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Apr 8 02:35:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:35:56.997763 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-3912126f-f738-41bd-82c0-1b3f36544c08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:35:57.033633 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-3912126f-f738-41bd-82c0-1b3f36544c08 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039367 Apr 08 02:35:57.034210 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1332 bytes} [Fri Apr 8 02:35:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:35:59.179805 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-81cfaac8-846e-4150-853f-d388f421f61b admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:35:59.180831 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-81cfaac8-846e-4150-853f-d388f421f61b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001704 Apr 08 02:35:59.181225 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 930 bytes} [Fri Apr 8 02:35:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:35:59.236150 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-a13dc488-8cdb-461b-b698-7cb9850631ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:35:59.259611 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-a13dc488-8cdb-461b-b698-7cb9850631ed admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072752 Apr 08 02:35:59.260173 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Apr 8 02:35:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:35:59.271942 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-e955d639-56eb-48c6-aa70-67a706fd5f34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:35:59.307072 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-e955d639-56eb-48c6-aa70-67a706fd5f34 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039249 Apr 08 02:35:59.307632 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1332 bytes} [Fri Apr 8 02:35:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:36:01.468511 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-a13dc488-8cdb-461b-b698-7cb9850631ed admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:36:01.469518 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-a13dc488-8cdb-461b-b698-7cb9850631ed admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Apr 08 02:36:01.469919 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 930 bytes} [Fri Apr 8 02:36:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:36:01.526993 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-763bb4cc-a781-4f09-b01f-f714a181a187 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "disk": 80, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:36:01.550456 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-763bb4cc-a781-4f09-b01f-f714a181a187 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073711 Apr 08 02:36:01.550995 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Apr 8 02:36:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:36:01.562864 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-87051507-ff7a-4922-a57b-b63e52bfad14 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:36:01.596291 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-87051507-ff7a-4922-a57b-b63e52bfad14 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037047 Apr 08 02:36:01.596851 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1332 bytes} [Fri Apr 8 02:36:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:36:03.739188 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-763bb4cc-a781-4f09-b01f-f714a181a187 admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:36:03.740247 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-763bb4cc-a781-4f09-b01f-f714a181a187 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Apr 08 02:36:03.740641 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 930 bytes} [Fri Apr 8 02:36:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:36:03.797528 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-028c9de0-f333-4d5a-aeda-1cce23b49017 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "id": "5", "os-flavor-access:is_public": true}} {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:36:03.820808 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-028c9de0-f333-4d5a-aeda-1cce23b49017 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074485 Apr 08 02:36:03.821341 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1282 bytes} [Fri Apr 8 02:36:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:36:03.833408 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-62c5bff3-1289-4c72-b35c-b2495ca15885 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:36:03.869238 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-62c5bff3-1289-4c72-b35c-b2495ca15885 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040063 Apr 08 02:36:03.869813 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1332 bytes} [Fri Apr 8 02:36:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:37:11.060211 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-028c9de0-f333-4d5a-aeda-1cce23b49017 admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:11.061203 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-028c9de0-f333-4d5a-aeda-1cce23b49017 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Apr 08 02:37:11.061626 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 930 bytes} [Fri Apr 8 02:37:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:37:11.116994 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-72b2114c-0773-4d39-8132-5cf7183df765 admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:11.139690 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-72b2114c-0773-4d39-8132-5cf7183df765 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071862 Apr 08 02:37:11.140255 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1291 bytes} [Fri Apr 8 02:37:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:37:12.559565 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-028c9de0-f333-4d5a-aeda-1cce23b49017 admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:12.560610 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-028c9de0-f333-4d5a-aeda-1cce23b49017 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Apr 08 02:37:12.561001 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Apr 8 02:37:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:37:12.748832 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-92126829-b164-450d-bdad-fa5d4175c024 admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:12.761812 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.wsgi [None req-92126829-b164-450d-bdad-fa5d4175c024 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 08 02:37:12.762314 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-92126829-b164-450d-bdad-fa5d4175c024 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=86543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:37:12.763097 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-92126829-b164-450d-bdad-fa5d4175c024 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.063359 Apr 08 02:37:12.763601 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Apr 8 02:37:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:12.772928 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-3a69bde2-1ed3-4d3c-b0d1-39dba1cd852f admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:12.792243 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-3a69bde2-1ed3-4d3c-b0d1-39dba1cd852f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.022788 Apr 08 02:37:12.792768 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Apr 8 02:37:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:37:12.802594 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-d5600dd6-d128-4b15-9ca5-f18c031efc47 admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:12.822948 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-d5600dd6-d128-4b15-9ca5-f18c031efc47 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024325 Apr 08 02:37:12.823503 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Apr 8 02:37:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:37:12.835548 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-b7a9ecfa-e7ec-4811-b77d-f4fb07112319 admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:12.848031 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.wsgi [None req-b7a9ecfa-e7ec-4811-b77d-f4fb07112319 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 08 02:37:12.848619 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-b7a9ecfa-e7ec-4811-b77d-f4fb07112319 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=86542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:37:12.849421 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-b7a9ecfa-e7ec-4811-b77d-f4fb07112319 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.019058 Apr 08 02:37:12.850127 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Apr 8 02:37:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:14.209434 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-d5600dd6-d128-4b15-9ca5-f18c031efc47 admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:14.210431 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-d5600dd6-d128-4b15-9ca5-f18c031efc47 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Apr 08 02:37:14.210825 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Apr 8 02:37:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:37:14.396000 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-c1cf06e0-c620-49ab-a87e-61094061559b admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:14.407801 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.wsgi [None req-c1cf06e0-c620-49ab-a87e-61094061559b admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 08 02:37:14.408399 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-c1cf06e0-c620-49ab-a87e-61094061559b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=86542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:37:14.409235 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-c1cf06e0-c620-49ab-a87e-61094061559b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.063330 Apr 08 02:37:14.409821 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Apr 8 02:37:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:14.419207 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-4ababc6f-ae9a-4e8c-96ac-b0fcdfbe7c42 admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:14.440393 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-4ababc6f-ae9a-4e8c-96ac-b0fcdfbe7c42 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024725 Apr 08 02:37:14.441531 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Apr 8 02:37:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:37:14.450888 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-3af376a4-8bb2-4757-b295-d26c6c2faf4c admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:14.470530 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-3af376a4-8bb2-4757-b295-d26c6c2faf4c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023094 Apr 08 02:37:14.471062 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Apr 8 02:37:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:37:14.480380 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-42491213-64cd-4953-9d4d-c805b5888be2 admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:14.493048 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.wsgi [None req-42491213-64cd-4953-9d4d-c805b5888be2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 08 02:37:14.493592 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-42491213-64cd-4953-9d4d-c805b5888be2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=86543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:37:14.494431 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-42491213-64cd-4953-9d4d-c805b5888be2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.017611 Apr 08 02:37:14.495201 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Apr 8 02:37:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:15.839711 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-3af376a4-8bb2-4757-b295-d26c6c2faf4c admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:15.840732 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-3af376a4-8bb2-4757-b295-d26c6c2faf4c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Apr 08 02:37:15.841125 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Apr 8 02:37:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:37:16.028726 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-8085ac32-160f-4fcc-a5b2-73bfbc871b43 admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:16.041244 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.wsgi [None req-8085ac32-160f-4fcc-a5b2-73bfbc871b43 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 08 02:37:16.041813 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-8085ac32-160f-4fcc-a5b2-73bfbc871b43 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=86543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:37:16.042600 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-8085ac32-160f-4fcc-a5b2-73bfbc871b43 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.063154 Apr 08 02:37:16.043113 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Apr 8 02:37:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 08 02:37:16.053131 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-4f32b255-b18f-4385-b668-3feed607ae10 admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:16.072920 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-4f32b255-b18f-4385-b668-3feed607ae10 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024008 Apr 08 02:37:16.073433 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Apr 8 02:37:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:37:16.083204 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-44c9e8d9-0321-4b76-9b31-0ec4820c8d5a admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:16.103512 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-44c9e8d9-0321-4b76-9b31-0ec4820c8d5a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024285 Apr 08 02:37:16.104042 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Apr 8 02:37:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:37:16.112997 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-6de76da6-30f6-4b7c-8fc2-5959a9ebcc8a admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:16.125568 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.wsgi [None req-6de76da6-30f6-4b7c-8fc2-5959a9ebcc8a admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 08 02:37:16.126125 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-6de76da6-30f6-4b7c-8fc2-5959a9ebcc8a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=86542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:37:16.126903 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-6de76da6-30f6-4b7c-8fc2-5959a9ebcc8a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.017386 Apr 08 02:37:16.127390 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Apr 8 02:37:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 08 02:37:17.472783 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-44c9e8d9-0321-4b76-9b31-0ec4820c8d5a admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:17.474401 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-44c9e8d9-0321-4b76-9b31-0ec4820c8d5a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002081 Apr 08 02:37:17.474804 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Apr 8 02:37:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:37:17.660693 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-f44d7c8b-ef26-41d5-896b-125260801717 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:17.685102 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-f44d7c8b-ef26-41d5-896b-125260801717 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.073912 Apr 08 02:37:17.685574 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Fri Apr 8 02:37:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:37:19.041592 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-44c9e8d9-0321-4b76-9b31-0ec4820c8d5a admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:19.042592 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-44c9e8d9-0321-4b76-9b31-0ec4820c8d5a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Apr 08 02:37:19.042996 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Apr 8 02:37:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:37:19.233905 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-2356e4d9-02fa-40be-82b9-efb66bd3e50a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:19.260398 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-2356e4d9-02fa-40be-82b9-efb66bd3e50a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.077831 Apr 08 02:37:19.260870 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Fri Apr 8 02:37:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:37:20.628607 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-44c9e8d9-0321-4b76-9b31-0ec4820c8d5a admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:20.629731 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-44c9e8d9-0321-4b76-9b31-0ec4820c8d5a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Apr 08 02:37:20.630134 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Apr 8 02:37:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:37:20.815898 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-9ec9ee47-5e0b-454c-80b5-b4d320d99aa4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:20.840279 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-9ec9ee47-5e0b-454c-80b5-b4d320d99aa4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.074838 Apr 08 02:37:20.840820 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Fri Apr 8 02:37:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:37:22.192891 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-44c9e8d9-0321-4b76-9b31-0ec4820c8d5a admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:22.193886 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-44c9e8d9-0321-4b76-9b31-0ec4820c8d5a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Apr 08 02:37:22.194286 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Apr 8 02:37:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:37:22.383489 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-f600ebfb-490e-4cc7-b9a9-d92d2b4de3f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:22.406402 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-f600ebfb-490e-4cc7-b9a9-d92d2b4de3f5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.074774 Apr 08 02:37:22.406869 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Fri Apr 8 02:37:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:37:23.781569 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-44c9e8d9-0321-4b76-9b31-0ec4820c8d5a admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:23.782560 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-44c9e8d9-0321-4b76-9b31-0ec4820c8d5a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Apr 08 02:37:23.782952 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Apr 8 02:37:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:37:23.972986 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-d9ba4ea7-f1d3-49a6-8142-549decae9686 admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:23.998340 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-d9ba4ea7-f1d3-49a6-8142-549decae9686 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.075668 Apr 08 02:37:23.998873 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Fri Apr 8 02:37:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:38:04.560333 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-44c9e8d9-0321-4b76-9b31-0ec4820c8d5a admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:04.561326 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-44c9e8d9-0321-4b76-9b31-0ec4820c8d5a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Apr 08 02:38:04.561722 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 31/63] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Apr 8 02:38:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:38:04.754479 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-fe3d90c8-ba6b-4a39-b93e-e72a5e67245f admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:04.780097 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-fe3d90c8-ba6b-4a39-b93e-e72a5e67245f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.082161 Apr 08 02:38:04.780568 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1202 bytes} [Fri Apr 8 02:38:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:39:47.590113 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-cebe12aa-b450-4e19-811d-b3bc474ff9e9 tempest-verify_tempest_config-731623810 tempest-verify_tempest_config-731623810-project] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:39:47.592162 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-cebe12aa-b450-4e19-811d-b3bc474ff9e9 tempest-verify_tempest_config-731623810 tempest-verify_tempest_config-731623810-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.112588 Apr 08 02:39:47.593605 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 32/65] 10.222.0.23 () {58 vars in 1133 bytes} [Fri Apr 8 02:39:47 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:41:23.153098 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-fe3d90c8-ba6b-4a39-b93e-e72a5e67245f admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:41:23.154684 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-fe3d90c8-ba6b-4a39-b93e-e72a5e67245f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Apr 08 02:41:23.154895 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 34/66] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Apr 8 02:41:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:41:23.412526 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-f2c539c5-b0ca-40b2-8ff1-39e6f6b008e3 admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:41:23.413696 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:41:23.413696 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: warnings.warn(msg) Apr 08 02:41:23.415252 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-f2c539c5-b0ca-40b2-8ff1-39e6f6b008e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:41:23.415696 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-f2c539c5-b0ca-40b2-8ff1-39e6f6b008e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:41:23.416518 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-f2c539c5-b0ca-40b2-8ff1-39e6f6b008e3 admin admin] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:41:23.416952 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-f2c539c5-b0ca-40b2-8ff1-39e6f6b008e3 admin admin] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:41:23.449938 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-f2c539c5-b0ca-40b2-8ff1-39e6f6b008e3 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.155125 Apr 08 02:41:23.450667 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Apr 8 02:41:23 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:41:24.837755 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-fe3d90c8-ba6b-4a39-b93e-e72a5e67245f admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:41:24.838740 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-fe3d90c8-ba6b-4a39-b93e-e72a5e67245f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Apr 08 02:41:24.839136 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 35/68] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Apr 8 02:41:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:41:25.027033 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-dd2adc74-29f0-4ae2-96ec-1c7382225456 admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:41:25.028223 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:41:25.028223 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: warnings.warn(msg) Apr 08 02:41:25.029895 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-dd2adc74-29f0-4ae2-96ec-1c7382225456 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:41:25.030338 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-dd2adc74-29f0-4ae2-96ec-1c7382225456 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:41:25.031150 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-dd2adc74-29f0-4ae2-96ec-1c7382225456 admin admin] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:41:25.031630 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-dd2adc74-29f0-4ae2-96ec-1c7382225456 admin admin] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:41:25.054290 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-dd2adc74-29f0-4ae2-96ec-1c7382225456 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.078076 Apr 08 02:41:25.054758 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 34/69] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Apr 8 02:41:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:41:36.804533 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-fe3d90c8-ba6b-4a39-b93e-e72a5e67245f admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:41:36.805536 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-fe3d90c8-ba6b-4a39-b93e-e72a5e67245f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001691 Apr 08 02:41:36.805938 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 36/70] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Apr 8 02:41:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:41:36.992994 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-bfdf27c5-a17a-4abe-8249-47f6d39dbed8 admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:41:36.994157 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:41:36.994157 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: warnings.warn(msg) Apr 08 02:41:36.995651 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-bfdf27c5-a17a-4abe-8249-47f6d39dbed8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:41:36.996129 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-bfdf27c5-a17a-4abe-8249-47f6d39dbed8 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:41:36.996912 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-bfdf27c5-a17a-4abe-8249-47f6d39dbed8 admin admin] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:41:36.997340 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-bfdf27c5-a17a-4abe-8249-47f6d39dbed8 admin admin] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:41:37.025733 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-bfdf27c5-a17a-4abe-8249-47f6d39dbed8 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.083049 Apr 08 02:41:37.026207 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 35/71] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Apr 8 02:41:36 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:41:38.387879 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: DEBUG nova.api.openstack.wsgi [None req-fe3d90c8-ba6b-4a39-b93e-e72a5e67245f admin admin] Calling method '>' {{(pid=86542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:41:38.388891 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: INFO nova.api.openstack.requestlog [None req-fe3d90c8-ba6b-4a39-b93e-e72a5e67245f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Apr 08 02:41:38.389286 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: [pid: 86542|app: 0|req: 37/72] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Apr 8 02:41:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:41:38.581515 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG nova.api.openstack.wsgi [None req-1c7bccbf-6025-4f61-8cc5-964748d1aac4 admin admin] Calling method '>' {{(pid=86543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:41:38.582703 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:41:38.582703 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: warnings.warn(msg) Apr 08 02:41:38.584229 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-1c7bccbf-6025-4f61-8cc5-964748d1aac4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:41:38.584672 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-1c7bccbf-6025-4f61-8cc5-964748d1aac4 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:41:38.585452 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-1c7bccbf-6025-4f61-8cc5-964748d1aac4 admin admin] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:41:38.585878 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: DEBUG oslo_concurrency.lockutils [None req-1c7bccbf-6025-4f61-8cc5-964748d1aac4 admin admin] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:41:38.611024 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: INFO nova.api.openstack.requestlog [None req-1c7bccbf-6025-4f61-8cc5-964748d1aac4 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.080832 Apr 08 02:41:38.611564 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: [pid: 86543|app: 0|req: 36/73] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Apr 8 02:41:38 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:42:36.685410 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: Fri Apr 8 02:42:36 2022 - graceful shutdown triggered... Apr 08 02:42:36.685191 dv-cinder-837051-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 08 02:42:36.686397 dv-cinder-837051-1-iscsi devstack@n-api.service[86542]: Gracefully killing worker 1 (pid: 86542)... Apr 08 02:42:36.686762 dv-cinder-837051-1-iscsi devstack@n-api.service[86543]: Gracefully killing worker 2 (pid: 86543)... Apr 08 02:42:37.686205 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: worker 1 buried after 1 seconds Apr 08 02:42:37.686205 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: worker 2 buried after 1 seconds Apr 08 02:42:37.686205 dv-cinder-837051-1-iscsi devstack@n-api.service[86541]: goodbye to uWSGI. Apr 08 02:42:37.687802 dv-cinder-837051-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 08 02:42:37.688406 dv-cinder-837051-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 08 02:42:37.691353 dv-cinder-837051-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 08 02:42:37.700733 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 08 02:42:37.702725 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 8 02:42:37 2022] *** Apr 08 02:42:37.702725 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 08 02:42:37.702725 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 08 02:42:37.702725 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: nodename: dv-cinder-837051-1-iscsi Apr 08 02:42:37.702725 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: machine: x86_64 Apr 08 02:42:37.702725 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: clock source: unix Apr 08 02:42:37.702725 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: pcre jit disabled Apr 08 02:42:37.702725 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: detected number of CPU cores: 4 Apr 08 02:42:37.702725 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: current working directory: / Apr 08 02:42:37.702725 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: detected binary path: /usr/bin/uwsgi-core Apr 08 02:42:37.703368 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: your processes number limit is 47680 Apr 08 02:42:37.703368 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: your memory page size is 4096 bytes Apr 08 02:42:37.703368 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: detected max file descriptor number: 2048 Apr 08 02:42:37.703368 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: lock engine: pthread robust mutexes Apr 08 02:42:37.703368 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: thunder lock: enabled Apr 08 02:42:37.703368 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 08 02:42:37.703368 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 08 02:42:37.748595 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: Python main interpreter initialized at 0x559a63e619c0 Apr 08 02:42:37.748595 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: python threads support enabled Apr 08 02:42:37.748595 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: your server socket listen backlog is limited to 100 connections Apr 08 02:42:37.748595 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: your mercy for graceful operations on workers is 90 seconds Apr 08 02:42:37.749001 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: mapped 403077 bytes (393 KB) for 2 cores Apr 08 02:42:37.749069 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: *** Operational MODE: preforking *** Apr 08 02:42:37.749404 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: *** uWSGI is running in multiple interpreter mode *** Apr 08 02:42:37.749404 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: spawned uWSGI master process (pid: 101255) Apr 08 02:42:37.749611 dv-cinder-837051-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 08 02:42:37.751018 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: spawned uWSGI worker 1 (pid: 101271, cores: 1) Apr 08 02:42:37.751018 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: spawned uWSGI worker 2 (pid: 101272, cores: 1) Apr 08 02:42:37.751018 dv-cinder-837051-1-iscsi devstack@n-api.service[101255]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 08 02:42:41.953004 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 08 02:42:41.953628 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 08 02:42:41.953769 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 08 02:42:41.954103 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 08 02:42:41.954362 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 08 02:42:41.955532 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.955834 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.956385 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.956720 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.957059 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.957379 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.957710 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.958042 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.958377 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.958646 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.958965 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.959295 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837051-1-iscsi {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.959620 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.959956 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.960279 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.960609 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.960917 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.961245 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.961559 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.962069 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.963454 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.963454 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.963454 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.963850 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.964160 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.964407 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.964741 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.965068 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.965380 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.965708 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.966020 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837051-1-iscsi {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.966341 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.966653 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.966974 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.967396 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.967732 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.968075 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.968400 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.968725 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.969047 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.969394 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.969716 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.970088 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.970403 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.971042 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.971042 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.971365 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.971692 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.972127 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.972388 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.972614 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.972853 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.973187 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.973710 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.973954 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.974200 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.974433 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.974658 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.975404 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.975404 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.976014 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.976014 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.976467 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.976467 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.976906 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.977123 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.977379 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.977718 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.978004 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.978353 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.978605 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.978924 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.979330 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.979568 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.979887 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.980259 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.980583 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.980899 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.981219 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.981545 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.981859 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.982172 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.982537 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.982810 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.983146 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.983436 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.983698 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.984024 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.984337 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.984659 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.985011 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.985393 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.985571 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.985904 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.986527 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.986527 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.986967 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.987188 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.987499 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.987824 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.988565 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.988565 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.988869 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.989050 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.989374 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.989688 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.989997 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.990310 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.990622 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.990994 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.992038 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.992038 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.992449 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.992449 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.992743 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.992981 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.993295 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.993607 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.993930 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.994234 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.994546 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.994868 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.995182 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.995549 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.995795 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.996103 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.996418 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.996726 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.997033 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.997341 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.997642 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.997967 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.998294 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.998611 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.998919 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.999231 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.999555 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:41.999897 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.000258 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.000608 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.000927 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.001265 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.002169 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.002865 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.003025 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.003284 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.003595 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.003875 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.004284 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.004569 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.004895 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.005474 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.005814 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.006185 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.006457 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.007107 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.007107 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.007558 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.007796 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.008157 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.008475 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.008832 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.009183 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.009504 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.009834 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.010165 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.010486 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.010849 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.011122 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.011453 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.011781 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.012124 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.012452 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.012771 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.013091 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.013478 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.013743 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.014060 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.014370 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.015909 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.015909 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.015909 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.016557 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.016557 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.016847 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.016996 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.018338 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.018338 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.018721 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.018721 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.019114 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.019358 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.019697 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.020037 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.020380 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.020701 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.021021 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.021338 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.021644 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.021966 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.022285 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.022605 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.022936 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.023250 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.023596 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.023886 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.024257 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.024630 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.024860 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.025170 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.025492 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.025811 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.026304 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.026665 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.026900 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.027129 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.027411 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.027723 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.028145 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.028394 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.028773 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.029176 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.029413 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.029632 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.029924 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.030234 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.030551 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.030858 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.031162 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.031473 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.031782 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.032250 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.032583 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.033102 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.033820 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.033820 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.034225 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.034570 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.034810 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.035129 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.035455 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.035786 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.036190 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.036481 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.036772 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.037085 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.037404 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.037737 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.038052 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.038374 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.038685 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.039009 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.039333 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.039669 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.040035 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.040331 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.040658 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.040974 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.041288 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.041707 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.042810 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.042810 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.042810 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.042810 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.043435 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.043435 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.043729 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.044133 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.044380 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.044692 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.045002 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.045322 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.045654 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.045972 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.046324 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.046697 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.046984 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.047225 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.047552 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.047868 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.048209 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.049762 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.049762 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.050104 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.050321 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.050637 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.050966 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.051295 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.051616 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.052447 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.052447 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.052774 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.052924 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.053480 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.053795 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.054312 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.054496 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.054762 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.055039 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.055365 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.055681 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.056022 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.056341 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.056650 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.057076 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.057513 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.057857 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.058193 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.058513 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.058839 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.059163 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.059494 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.059868 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.060201 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.060593 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.060825 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.061141 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.061450 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.061758 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.062073 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.062383 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.062694 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.063003 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.063317 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.063624 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.064006 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.065716 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.065716 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.065716 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.066156 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.066156 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.066452 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.067013 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 08 02:42:42.068788 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.068958 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 08 02:42:42.069116 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.069273 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 08 02:42:42.069418 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.069418 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.069706 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 08 02:42:42.069706 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 08 02:42:42.070205 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.070205 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.070498 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.070667 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.070929 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.071092 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.071246 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.071399 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.071541 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.071541 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.071826 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.071999 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.072161 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.072161 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.072455 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.072683 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.072924 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.073253 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.073555 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.073772 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.074006 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.074175 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.074337 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.074497 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.074751 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837051-1-iscsi {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.075163 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.075435 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.076000 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.076164 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.076395 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.076659 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.076947 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.077288 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.077540 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.077784 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.078020 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.078261 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.078798 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.079038 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.079283 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.079283 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.079786 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.080109 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.080621 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.080874 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.081259 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.081505 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.081745 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.081979 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.082204 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.082443 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.082443 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.082891 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.083123 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.083365 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.083712 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.083989 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.084235 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.084396 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.084547 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.084696 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.084860 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.085013 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.085294 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.085452 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837051-1-iscsi {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.085610 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.085777 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.086332 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.086506 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.086664 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.086822 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.086977 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.086977 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.087495 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.087661 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.087810 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.087990 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.088157 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.088314 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.088463 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.088642 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.089050 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.089217 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.089388 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.089549 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.089706 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.089861 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.089861 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.090154 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.090320 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.090682 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.090838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.090994 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.091154 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.091312 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.091488 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.091734 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.091895 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.092122 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.092122 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.092575 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.092754 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.092914 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.092914 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.093198 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.093365 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.093523 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.093673 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.093673 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.093954 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.094102 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.094102 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.094402 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.094559 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.094803 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.095737 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.097552 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.097739 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.097739 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.098043 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.098194 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.098350 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.098501 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.098501 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.098808 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.098983 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.098983 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.099477 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.099629 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.099629 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.099968 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.100137 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.100286 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.100441 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.100621 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.100938 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.100938 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.101243 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.101392 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.101539 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.101702 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.101702 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.102210 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.102374 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.102374 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.102676 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.102836 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.102986 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.103214 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.103372 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.103522 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.103669 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.103827 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.103827 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.104250 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.104417 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.104575 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.104737 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.104944 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.105102 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.105102 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.105401 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.105573 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.105813 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.105976 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.106125 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.106280 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.106280 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.106578 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.106740 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.106899 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.107057 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.107224 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.107665 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.107830 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.108011 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.108167 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.108323 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.108480 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.108628 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.108628 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.108937 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.109087 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.113560 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.113670 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.113747 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.113855 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.113952 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.114037 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.114129 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.114129 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.114292 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.114385 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.114477 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.114477 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.114639 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.114718 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.114718 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.114855 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.114935 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.114935 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.115097 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.115180 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.115262 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.115356 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.115440 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.115522 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.115522 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.115680 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.115772 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.115772 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.115910 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.116026 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.116121 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.116205 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.116303 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.116395 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.116480 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.116570 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.116570 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.116721 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.116812 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.116904 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.116987 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.117076 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.117167 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.117251 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.117342 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.117429 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.117502 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.117572 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.117649 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.117745 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.117818 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.117887 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.117964 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.118041 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.118118 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.118281 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.118367 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.118451 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.118548 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.118634 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.118724 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.118821 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.118906 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.118989 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.119072 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.119155 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.119238 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.119238 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.119408 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.119487 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.119567 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.119567 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.120430 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.120551 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.120679 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.120809 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.120989 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.121108 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.121229 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.121229 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.121229 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.121229 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.121229 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.121229 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.121229 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.121229 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.122076 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.122189 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.122301 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.122418 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.122538 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.122651 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.122651 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.122875 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.122987 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.122987 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.123192 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.123309 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.123434 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.123546 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.123546 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.123752 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.123874 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.124021 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.124149 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.124262 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.124403 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.124515 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.124625 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.124745 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.124867 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.124978 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.125096 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.125207 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.125335 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.125459 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.125572 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.125682 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.125800 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.125929 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.126048 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.126169 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.126280 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.126401 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:42:42.127123 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.127123 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.127346 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.127485 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.127598 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.127715 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.127827 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.128014 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.128149 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.128272 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.128384 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.128504 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.128634 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.128754 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.128875 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.128989 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.129109 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.129232 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.129352 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.129464 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.129592 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.129715 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.129834 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.129953 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.130067 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.130203 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.130325 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.130445 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.130564 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.130686 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.130804 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.130925 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.131045 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.131045 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.131272 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.131385 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.131495 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.131619 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.131742 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.131854 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.131983 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.132114 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.132242 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.132242 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.132465 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.132576 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.132705 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.132817 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.132935 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.133055 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.133178 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.133296 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.133408 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.133518 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.133676 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.133875 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.134017 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.134132 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.134322 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.134411 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.134497 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.134569 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.134646 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.134717 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.134793 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.134871 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.134954 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.135025 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.135094 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.135290 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.135492 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.135620 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.135741 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.135860 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.136035 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.136152 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.136152 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.136397 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.136511 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.136511 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.136728 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.136838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.136955 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.137076 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.137076 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.137310 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.137432 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.137552 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.137663 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.137851 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.137980 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.138108 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.138227 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.138338 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.138458 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.138579 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.138692 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.138692 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.138916 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.139036 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.139243 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.139411 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.139615 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.139864 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.140064 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.140228 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.140394 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.140547 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.140700 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.140860 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.141012 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.141171 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.141336 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.141489 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.141649 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.141821 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.141981 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.142740 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.142967 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.142967 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.143281 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.143440 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.143660 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.143830 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.144022 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.144295 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.144457 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.144627 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.144794 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.144947 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.145105 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.145258 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.145409 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.145560 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.145721 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.145873 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.146103 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.146265 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.146416 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.146567 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.146742 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.146895 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.147054 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.147206 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.147365 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.147516 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.147676 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.147838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.148031 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.148187 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.148347 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.148513 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.148677 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.148828 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.148989 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.149142 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.149294 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.149454 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.149605 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.149757 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.149908 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.150060 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.150219 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.150379 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.150532 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.150701 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.150854 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.151049 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.151224 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.151450 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.151611 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.151763 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.151943 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.152104 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.152267 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.152419 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.152569 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.152739 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.152891 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.153042 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.153202 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.153361 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.153513 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.153672 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.153823 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.153989 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.154155 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.154307 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.154457 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.154615 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.154777 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.154936 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.155097 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.155258 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.155417 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.155417 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.155706 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.155871 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.156146 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.156311 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.156463 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.156613 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.156845 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.157018 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.157177 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.157339 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.157490 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.157648 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.158402 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.158574 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.158735 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.158887 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.159039 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.159197 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.159197 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.159501 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.159662 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.159821 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.159989 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.160164 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.160327 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.160488 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.160639 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.160791 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.160941 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.161091 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.161255 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.161407 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.161407 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.161708 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.161858 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.162009 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.162178 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.162330 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.162480 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.162704 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.162858 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.163023 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.163175 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.163334 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.163493 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.163656 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.163815 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.164000 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.164159 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.164317 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.164469 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.164621 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.164772 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.164932 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.164932 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.165227 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.165379 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.165529 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.165702 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.165863 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.166023 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.166175 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.166333 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.166485 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.166650 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.166804 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.166954 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.167105 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.167255 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.167413 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.167578 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.167742 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.168092 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.168254 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.168406 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.168557 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.168769 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.168924 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.169075 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.169226 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.169386 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.169538 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.169708 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.169880 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.170033 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.170183 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.170333 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.170484 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.170648 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.170801 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.170952 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.171113 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.171265 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.171265 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.171574 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.171726 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.171892 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.172079 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.172241 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.172402 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.172561 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.172758 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.173100 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.173270 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.173531 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.173713 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.173868 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.174028 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.174188 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.174358 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.174510 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.174671 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.174824 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.174975 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.175127 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.175278 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.175438 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.175598 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.175751 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.175902 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.176076 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.176229 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.176406 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.176560 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.176719 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.176878 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.177030 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.177191 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.177352 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.177505 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.177656 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.177807 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.177958 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.178117 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.178537 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.178698 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.178858 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.179019 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.179180 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.179346 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.179507 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.179659 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.179817 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.179989 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.180159 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.180327 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.180488 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.180658 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.180818 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.180818 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.181114 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.181274 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.181428 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.181586 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.181738 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.181896 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.182056 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.182209 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.182362 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.182536 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.182688 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.182839 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.183004 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.183156 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.183307 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.183475 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.183628 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.183778 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.183959 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.184117 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.184279 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.184431 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.184593 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.184753 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.184913 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.185064 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.185231 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.185397 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.185559 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.185713 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.185873 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.186033 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.186185 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.186344 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.186519 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.186672 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.186824 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.186982 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.187142 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.187142 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.187461 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.187621 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.187775 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.187941 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.188105 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.188268 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.188428 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.188589 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.188749 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.188900 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.189092 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.189254 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.189406 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.189685 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.190455 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.190616 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.190770 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.190770 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.191294 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.191538 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.191701 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.191855 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.192089 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.192244 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.192409 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.192579 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.192739 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.192901 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.193062 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.193221 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.193399 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.193564 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.193715 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.193866 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.194027 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.194188 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.194354 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.194354 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.194644 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.194794 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.194953 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.195120 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.195281 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.195441 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.195604 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.195756 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.195916 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.196096 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.196258 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.196411 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.196570 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.196732 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.196885 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.197044 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.197198 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.197356 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.197508 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.197682 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.197843 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.198002 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.198002 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.198305 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.198463 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.198625 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.198778 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.198936 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.199090 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.199242 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.199392 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.199562 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.199723 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.199881 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.200056 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.200220 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.200389 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.200549 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.200710 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.200869 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.201021 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.201199 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.201602 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.201763 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.201927 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.202087 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.202248 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.202409 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.202571 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.202723 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.202876 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.203034 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.203198 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.203361 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.203522 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.203682 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.204012 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.204187 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.204339 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.204501 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.205397 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.205856 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.206062 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.206222 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.206374 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.206541 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.206677 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.206807 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.206927 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.207055 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.207175 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.207302 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.207396 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.207489 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.207574 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.207666 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.207759 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.207851 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.207953 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.207953 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.208109 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.208204 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.208304 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.208396 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.208481 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.208572 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.208657 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 08 02:42:42.208740 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.208740 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.208740 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.208740 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.208740 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.208740 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.209185 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.209322 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.209646 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.209967 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.210288 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.210599 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.210910 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.211340 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.211666 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.212075 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.212431 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.212729 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.213064 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.213377 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.213697 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.214015 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.214331 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.214648 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.214964 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.215284 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.215605 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.215941 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.216263 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.216579 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.216895 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.217213 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.217530 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.217840 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.218171 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.218487 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.218798 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.219113 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.219426 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.219744 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.220077 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.221192 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.221520 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.221842 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.222174 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.222488 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.222791 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.223117 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.223440 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.223752 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.224206 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.224535 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.224859 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.225269 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.225622 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.225901 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.226225 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.226562 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.226878 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.227190 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.227502 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.227890 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.228221 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.228610 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.229046 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.229352 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.229662 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.230085 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.230618 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.231131 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.231757 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.232296 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.232847 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.233355 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.233840 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.234405 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.235572 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.235572 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.235572 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.235572 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.236265 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.236413 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.236768 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.237099 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.237434 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.237869 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.238202 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.238523 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.238858 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.239193 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.239507 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.239819 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.240165 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.240481 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.240794 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.241127 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.241449 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.241768 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.242086 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.242470 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.242708 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.243018 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.243347 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.243525 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_db.sqlalchemy.engines [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:42:42.243691 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.243994 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.244321 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.244648 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.244975 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.245285 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.245612 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.245928 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.246242 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.246553 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.246865 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.247213 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.247526 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.247856 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.248229 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.248566 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.248884 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.249223 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.249557 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.249879 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.250204 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.250534 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.250847 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.251156 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.251504 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.251814 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.252147 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.252470 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.252772 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.253081 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.253392 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.253727 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.254020 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.254332 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.254659 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.254973 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.255283 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.255593 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.255904 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.256272 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.256579 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.256920 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.257246 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.257573 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.257910 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.258228 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.258558 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.258884 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.259211 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.259535 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.259857 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.260206 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.260530 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.260899 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.261171 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.261497 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.261820 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.262145 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.262719 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.263056 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.263377 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.263781 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.264115 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.264358 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.264678 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.264996 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.265312 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.265629 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.265947 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.266279 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.266607 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.266942 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.267804 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.268339 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.268913 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.269499 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.270075 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.270731 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.271083 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.271416 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.271755 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.272379 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.272758 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.273172 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.273512 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.274059 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.274650 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.275242 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.275636 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.275999 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.276341 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.276694 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.277053 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.277393 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.277726 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.278054 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.278381 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.278924 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.279254 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.279601 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.279966 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.280332 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.280662 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.280991 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.281334 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.281651 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.282001 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.282358 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.282804 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.283535 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.284072 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.284382 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.284702 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.285033 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.285352 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.285898 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.286255 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.286579 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.286913 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.287247 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.287571 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.287884 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.288240 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.288557 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.288871 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.289195 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.289515 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.289826 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.290188 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.290508 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.290827 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.291140 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.291467 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.291781 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.292145 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.292461 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.292773 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.293086 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.293408 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.293722 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.294032 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.294343 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.294863 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.295206 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.295556 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.295875 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.296215 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.296537 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.296851 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.297168 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.297478 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.297810 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.298124 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.298529 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.299061 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.299385 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.299718 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.300068 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.300392 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.300751 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.301076 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.301646 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.301987 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.302314 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.302664 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.303057 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.303577 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.303890 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.304304 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.304560 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.304881 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.305199 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.305517 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.305834 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.306151 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.306466 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.306781 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.307097 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.307413 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.307729 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.308067 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.308387 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.308708 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.309055 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.309383 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.309707 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.310028 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.310353 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.310669 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.311001 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.311315 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.311636 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.311977 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.312316 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.312634 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.312944 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.313420 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.313737 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.314111 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.314443 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.314762 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.315096 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.315443 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.315779 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.316139 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.316456 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.316791 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.317139 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.317474 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.317838 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.318183 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.318512 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.318842 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.319181 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.319505 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.319824 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.320170 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.320491 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.320813 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.321139 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.321472 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.321801 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.322118 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.322447 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.322765 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.323094 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.323408 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.323726 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.324068 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.324386 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.324726 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.325046 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.325375 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.325692 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.326019 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.326333 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.326659 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.326985 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.327306 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.327622 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.327981 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.328298 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.328614 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.328931 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.329247 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.330052 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.330434 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.330772 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.331188 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.331507 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.331844 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.332198 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.332527 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.332852 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.333172 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.333510 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.333827 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.334152 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.334583 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.334791 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.335115 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.335436 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.335767 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.336126 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.336455 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.336786 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.337138 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.337459 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.337808 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.338141 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:42:42.338388 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 08 02:42:42.372632 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_db.sqlalchemy.engines [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:42:42.491739 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.context [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e0d9f6c4-1da5-4232-a6ea-53cb1efa9180(cell1) {{(pid=101271) load_cells /opt/stack/nova/nova/context.py:464}} Apr 08 02:42:42.496093 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:42:42.497749 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:42:42.498550 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:42:42.500689 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:42:42.528005 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_db.sqlalchemy.engines [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:42:42.528757 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_db.sqlalchemy.engines [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:42:42.560049 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_db.sqlalchemy.engines [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:42:42.625795 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.context [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e0d9f6c4-1da5-4232-a6ea-53cb1efa9180(cell1) {{(pid=101272) load_cells /opt/stack/nova/nova/context.py:464}} Apr 08 02:42:42.630905 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:42:42.632658 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:42:42.633509 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:42:42.635543 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:42:42.662050 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_db.sqlalchemy.engines [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:42:42.670710 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_db.sqlalchemy.engines [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:42:42.698252 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_db.sqlalchemy.engines [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:42:42.808258 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO keyring.backend [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] Loading KWallet Apr 08 02:42:42.825943 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO keyring.backend [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] Loading SecretService Apr 08 02:42:42.832305 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 02:42:42.832305 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: from cryptography.utils import int_from_bytes Apr 08 02:42:42.832684 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 02:42:42.832684 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: from cryptography.utils import int_from_bytes Apr 08 02:42:42.833749 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO keyring.backend [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] Loading Windows Apr 08 02:42:42.837260 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO keyring.backend [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] Loading chainer Apr 08 02:42:42.838284 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO keyring.backend [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] Loading macOS Apr 08 02:42:42.946358 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO keyring.backend [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] Loading KWallet Apr 08 02:42:42.955524 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO keyring.backend [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] Loading SecretService Apr 08 02:42:42.959073 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 02:42:42.959073 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: from cryptography.utils import int_from_bytes Apr 08 02:42:42.959403 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 02:42:42.959403 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: from cryptography.utils import int_from_bytes Apr 08 02:42:42.960166 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO keyring.backend [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] Loading Windows Apr 08 02:42:42.962018 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO keyring.backend [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] Loading chainer Apr 08 02:42:42.963005 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO keyring.backend [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] Loading macOS Apr 08 02:42:43.117637 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: WARNING keystonemiddleware.auth_token [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 02:42:43.124233 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: WARNING keystonemiddleware.auth_token [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 02:42:43.225383 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: WARNING keystonemiddleware.auth_token [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 02:42:43.232085 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: WARNING keystonemiddleware.auth_token [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 02:42:43.360320 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: WARNING keystonemiddleware.auth_token [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 02:42:43.366962 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: WARNING keystonemiddleware.auth_token [None req-f0ca3796-c98d-4136-8b7f-81c2305283e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 02:42:43.372103 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559a63e619c0 pid: 101271 (default app) Apr 08 02:42:43.447436 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: WARNING keystonemiddleware.auth_token [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 02:42:43.453662 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: WARNING keystonemiddleware.auth_token [None req-7923f83c-6904-4aa3-8ddd-130f14335d1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 02:42:43.459368 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559a63e619c0 pid: 101272 (default app) Apr 08 02:43:46.925161 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4bb04311-58ca-4f51-aee3-96b0dd9b72be tempest-VolumesGetTestJSON-1650971115 tempest-VolumesGetTestJSON-1650971115-project] Action: 'create', calling method: .version_select at 0x7fbc39228ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-321490893", "metadata": {"Type": "work"}}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:43:47.278278 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-6095af48-7632-4dae-9a93-dac0f91d7a32 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1685664660", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452", "networks": [{"uuid": "12d51e45-31ff-422a-a96d-bba4d26b1a95"}]}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:43:48.518856 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.network.neutron [None req-6095af48-7632-4dae-9a93-dac0f91d7a32 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] validate_networks() for [('12d51e45-31ff-422a-a96d-bba4d26b1a95', None, None, None)] {{(pid=101272) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:43:49.732034 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4bb04311-58ca-4f51-aee3-96b0dd9b72be tempest-VolumesGetTestJSON-1650971115 tempest-VolumesGetTestJSON-1650971115-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.902038 Apr 08 02:43:49.733259 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1155 bytes} [Fri Apr 8 02:43:44 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4906 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 08 02:43:49.747332 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-820e3a54-8eee-46b9-81f4-32deda54a828 tempest-VolumesGetTestJSON-1650971115 tempest-VolumesGetTestJSON-1650971115-project] Calling method '.version_select at 0x7fbc3910e1f0>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:43:50.013704 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-820e3a54-8eee-46b9-81f4-32deda54a828 tempest-VolumesGetTestJSON-1650971115 tempest-VolumesGetTestJSON-1650971115-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/55a9a707-56e6-442d-8ccd-18a99077282b" status: 200 len: 352 microversion: 2.1 time: 0.271767 Apr 08 02:43:50.016269 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 2/2] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Apr 8 02:43:49 2022] GET /compute/v2.1/os-volumes/55a9a707-56e6-442d-8ccd-18a99077282b => generated 352 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:43:50.802176 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-6095af48-7632-4dae-9a93-dac0f91d7a32 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Flavor limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:43:50.803549 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-6095af48-7632-4dae-9a93-dac0f91d7a32 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Image limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:43:50.804448 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-6095af48-7632-4dae-9a93-dac0f91d7a32 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Flavor pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:43:50.805066 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-6095af48-7632-4dae-9a93-dac0f91d7a32 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Image pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:43:50.805706 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-6095af48-7632-4dae-9a93-dac0f91d7a32 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:43:50.829531 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6095af48-7632-4dae-9a93-dac0f91d7a32 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:43:50.830233 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6095af48-7632-4dae-9a93-dac0f91d7a32 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:43:50.831537 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6095af48-7632-4dae-9a93-dac0f91d7a32 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:43:50.832824 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6095af48-7632-4dae-9a93-dac0f91d7a32 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:43:50.883082 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-6095af48-7632-4dae-9a93-dac0f91d7a32 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Getting quotas for project a7827966303d4944b40900c83b7d40b9. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:43:50.893437 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-6095af48-7632-4dae-9a93-dac0f91d7a32 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Getting quotas for user f6ebb03a3a3f4e8cbc996251a4fefb8e and project a7827966303d4944b40900c83b7d40b9. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:43:50.920325 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-6095af48-7632-4dae-9a93-dac0f91d7a32 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Going to run 1 instances... {{(pid=101272) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:43:50.923288 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-6095af48-7632-4dae-9a93-dac0f91d7a32 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:43:51.033718 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4022342b-1c3e-479e-aff5-163c575c9f10 tempest-VolumesGetTestJSON-1650971115 tempest-VolumesGetTestJSON-1650971115-project] Calling method '.version_select at 0x7fbc3910ea60>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:43:51.080799 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-6095af48-7632-4dae-9a93-dac0f91d7a32 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.797773 Apr 08 02:43:51.088138 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:43:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 5807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 02:43:51.113296 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2cca9f5b-02dc-42e5-80f9-fd63acbd41dc tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:43:51.115307 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2cca9f5b-02dc-42e5-80f9-fd63acbd41dc tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:43:51.314804 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4022342b-1c3e-479e-aff5-163c575c9f10 tempest-VolumesGetTestJSON-1650971115 tempest-VolumesGetTestJSON-1650971115-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/55a9a707-56e6-442d-8ccd-18a99077282b" status: 200 len: 353 microversion: 2.1 time: 0.289602 Apr 08 02:43:51.326323 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 3/4] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Apr 8 02:43:51 2022] GET /compute/v2.1/os-volumes/55a9a707-56e6-442d-8ccd-18a99077282b => generated 353 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:43:51.365251 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-9ecce2e2-5e96-43c0-9a09-599295ee3d4a tempest-VolumesGetTestJSON-1650971115 tempest-VolumesGetTestJSON-1650971115-project] Calling method '.version_select at 0x7fbc3910ef70>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:43:51.409075 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2cca9f5b-02dc-42e5-80f9-fd63acbd41dc tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:43:51.436049 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2cca9f5b-02dc-42e5-80f9-fd63acbd41dc tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1215 microversion: 2.1 time: 0.345355 Apr 08 02:43:51.445653 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 2/5] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:43:51 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1215 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:43:51.610722 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-9ecce2e2-5e96-43c0-9a09-599295ee3d4a tempest-VolumesGetTestJSON-1650971115 tempest-VolumesGetTestJSON-1650971115-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/55a9a707-56e6-442d-8ccd-18a99077282b" status: 200 len: 353 microversion: 2.1 time: 0.279357 Apr 08 02:43:51.611288 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 4/6] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Apr 8 02:43:51 2022] GET /compute/v2.1/os-volumes/55a9a707-56e6-442d-8ccd-18a99077282b => generated 353 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:43:51.628099 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-41560189-e237-4991-8e1a-93bcc7ec7ef9 tempest-VolumesGetTestJSON-1650971115 tempest-VolumesGetTestJSON-1650971115-project] Calling method '.version_select at 0x7fbc3908aa60>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:43:51.931987 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-41560189-e237-4991-8e1a-93bcc7ec7ef9 tempest-VolumesGetTestJSON-1650971115 tempest-VolumesGetTestJSON-1650971115-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/55a9a707-56e6-442d-8ccd-18a99077282b" status: 202 len: 0 microversion: 2.1 time: 0.308370 Apr 08 02:43:51.933056 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 3/7] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Apr 8 02:43:51 2022] DELETE /compute/v2.1/os-volumes/55a9a707-56e6-442d-8ccd-18a99077282b => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:43:51.941645 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-dc4c9471-18bc-4ed8-9f51-1154ddf9214f tempest-VolumesGetTestJSON-1650971115 tempest-VolumesGetTestJSON-1650971115-project] Calling method '.version_select at 0x7fbc3910e670>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:43:52.161665 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-dc4c9471-18bc-4ed8-9f51-1154ddf9214f tempest-VolumesGetTestJSON-1650971115 tempest-VolumesGetTestJSON-1650971115-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/55a9a707-56e6-442d-8ccd-18a99077282b" status: 200 len: 352 microversion: 2.1 time: 0.224275 Apr 08 02:43:52.172728 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 5/8] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Apr 8 02:43:51 2022] GET /compute/v2.1/os-volumes/55a9a707-56e6-442d-8ccd-18a99077282b => generated 352 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:43:52.462562 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-22b31557-b289-446f-8b21-b6031a20a475 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:43:52.469126 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-22b31557-b289-446f-8b21-b6031a20a475 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:43:53.174327 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e10150fa-9e5f-4c3b-9f93-fc2bef535a93 tempest-VolumesGetTestJSON-1650971115 tempest-VolumesGetTestJSON-1650971115-project] Calling method '.version_select at 0x7fbc39123430>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:43:53.280046 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-e10150fa-9e5f-4c3b-9f93-fc2bef535a93 tempest-VolumesGetTestJSON-1650971115 tempest-VolumesGetTestJSON-1650971115-project] HTTP exception thrown: Volume 55a9a707-56e6-442d-8ccd-18a99077282b could not be found. Apr 08 02:43:53.280718 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e10150fa-9e5f-4c3b-9f93-fc2bef535a93 tempest-VolumesGetTestJSON-1650971115 tempest-VolumesGetTestJSON-1650971115-project] Returning 404 to user: Volume 55a9a707-56e6-442d-8ccd-18a99077282b could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:43:53.281584 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e10150fa-9e5f-4c3b-9f93-fc2bef535a93 tempest-VolumesGetTestJSON-1650971115 tempest-VolumesGetTestJSON-1650971115-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/55a9a707-56e6-442d-8ccd-18a99077282b" status: 404 len: 109 microversion: 2.1 time: 0.111564 Apr 08 02:43:53.282127 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 6/9] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Apr 8 02:43:53 2022] GET /compute/v2.1/os-volumes/55a9a707-56e6-442d-8ccd-18a99077282b => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:43:53.857552 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-22b31557-b289-446f-8b21-b6031a20a475 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:43:53.884669 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-22b31557-b289-446f-8b21-b6031a20a475 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1215 microversion: 2.1 time: 1.428670 Apr 08 02:43:53.885105 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 4/10] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:43:52 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1215 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:43:54.902333 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4676a93e-a446-467e-9694-bddf3bf3d4c1 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:43:54.903960 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-4676a93e-a446-467e-9694-bddf3bf3d4c1 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:43:54.925838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4676a93e-a446-467e-9694-bddf3bf3d4c1 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:43:54.931084 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4676a93e-a446-467e-9694-bddf3bf3d4c1 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:43:54.932071 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4676a93e-a446-467e-9694-bddf3bf3d4c1 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:43:54.932626 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4676a93e-a446-467e-9694-bddf3bf3d4c1 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:43:55.621937 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4676a93e-a446-467e-9694-bddf3bf3d4c1 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:43:55.661383 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4676a93e-a446-467e-9694-bddf3bf3d4c1 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1285 microversion: 2.1 time: 0.763073 Apr 08 02:43:55.665296 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 7/11] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:43:54 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1285 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:43:56.683373 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9cc5fa98-329d-4ae3-a8e1-5c64dec92fda tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:43:56.684609 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9cc5fa98-329d-4ae3-a8e1-5c64dec92fda tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:43:56.703629 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9cc5fa98-329d-4ae3-a8e1-5c64dec92fda tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:43:56.722256 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9cc5fa98-329d-4ae3-a8e1-5c64dec92fda tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:43:56.723624 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9cc5fa98-329d-4ae3-a8e1-5c64dec92fda tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:43:56.727482 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9cc5fa98-329d-4ae3-a8e1-5c64dec92fda tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:43:57.219209 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9cc5fa98-329d-4ae3-a8e1-5c64dec92fda tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:43:57.245308 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9cc5fa98-329d-4ae3-a8e1-5c64dec92fda tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1273 microversion: 2.1 time: 0.561973 Apr 08 02:43:57.246189 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 5/12] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:43:56 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1273 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:43:58.267174 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e0bca9b2-67c9-4d5a-be90-1629422e066b tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:43:58.272213 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e0bca9b2-67c9-4d5a-be90-1629422e066b tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:43:58.294560 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e0bca9b2-67c9-4d5a-be90-1629422e066b tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:43:58.297139 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e0bca9b2-67c9-4d5a-be90-1629422e066b tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:43:58.298196 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e0bca9b2-67c9-4d5a-be90-1629422e066b tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:43:58.298871 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e0bca9b2-67c9-4d5a-be90-1629422e066b tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:04.314506 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ee0cce1e-0ca3-4e73-bcde-64a6ce92fa22 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Action: 'create', calling method: .version_select at 0x7fbc3924d310>, body: {"keypair": {"name": "tempest-keypair-2051723958"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:04.413433 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-ee0cce1e-0ca3-4e73-bcde-64a6ce92fa22 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'key_pairs'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:44:04.429491 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-ee0cce1e-0ca3-4e73-bcde-64a6ce92fa22 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for user 44a64fb1ebd9411eb6156c8ef97c3072 and project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'key_pairs'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:44:05.625979 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-ee0cce1e-0ca3-4e73-bcde-64a6ce92fa22 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'key_pairs'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:44:05.648622 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-ee0cce1e-0ca3-4e73-bcde-64a6ce92fa22 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for user 44a64fb1ebd9411eb6156c8ef97c3072 and project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'key_pairs'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:44:05.698054 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ee0cce1e-0ca3-4e73-bcde-64a6ce92fa22 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 2.388382 Apr 08 02:44:05.700061 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 6/13] 10.222.0.23 () {60 vars in 1157 bytes} [Fri Apr 8 02:44:03 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 2391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:05.701159 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e0bca9b2-67c9-4d5a-be90-1629422e066b tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:05.713107 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e0bca9b2-67c9-4d5a-be90-1629422e066b tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1315 microversion: 2.1 time: 7.452393 Apr 08 02:44:05.724749 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 8/14] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:43:58 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1315 bytes in 7465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:06.731707 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f7c098bc-16d8-4adc-98b1-40129c8a204a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:06.733285 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f7c098bc-16d8-4adc-98b1-40129c8a204a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:06.752850 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f7c098bc-16d8-4adc-98b1-40129c8a204a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:06.757374 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f7c098bc-16d8-4adc-98b1-40129c8a204a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:06.758462 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f7c098bc-16d8-4adc-98b1-40129c8a204a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:06.759909 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f7c098bc-16d8-4adc-98b1-40129c8a204a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:06.863347 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-209d79e8-e278-4ba1-a7d8-18e50fdcae38 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Action: 'create', calling method: .version_select at 0x7fbc38788dc0>, body: {"keypair": {"name": "tempest-keypair-145837493"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:06.979338 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-209d79e8-e278-4ba1-a7d8-18e50fdcae38 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Getting quotas for project 688b5f689e3e41249484667a939fd5f8. Resources: {'key_pairs'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:44:06.992947 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-209d79e8-e278-4ba1-a7d8-18e50fdcae38 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Getting quotas for user e8e3c70e491a4f0691f753c8e2b95e95 and project 688b5f689e3e41249484667a939fd5f8. Resources: {'key_pairs'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:44:07.379840 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-209d79e8-e278-4ba1-a7d8-18e50fdcae38 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Getting quotas for project 688b5f689e3e41249484667a939fd5f8. Resources: {'key_pairs'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:44:07.401401 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-209d79e8-e278-4ba1-a7d8-18e50fdcae38 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Getting quotas for user e8e3c70e491a4f0691f753c8e2b95e95 and project 688b5f689e3e41249484667a939fd5f8. Resources: {'key_pairs'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:44:07.438057 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-209d79e8-e278-4ba1-a7d8-18e50fdcae38 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.022849 Apr 08 02:44:07.443184 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 7/15] 10.222.0.23 () {62 vars in 1198 bytes} [Fri Apr 8 02:44:06 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1029 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 08 02:44:08.117835 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f7c098bc-16d8-4adc-98b1-40129c8a204a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:08.130866 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f7c098bc-16d8-4adc-98b1-40129c8a204a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1315 microversion: 2.1 time: 1.403154 Apr 08 02:44:08.143999 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 9/16] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:06 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1315 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:09.148267 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-7e1e6695-db27-4576-827d-56c3ef27f100 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:09.149492 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-7e1e6695-db27-4576-827d-56c3ef27f100 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:09.166701 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7e1e6695-db27-4576-827d-56c3ef27f100 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:09.175303 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7e1e6695-db27-4576-827d-56c3ef27f100 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:09.177609 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7e1e6695-db27-4576-827d-56c3ef27f100 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:09.178492 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7e1e6695-db27-4576-827d-56c3ef27f100 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:10.733009 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-7e1e6695-db27-4576-827d-56c3ef27f100 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:10.779090 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-7e1e6695-db27-4576-827d-56c3ef27f100 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1315 microversion: 2.1 time: 1.626102 Apr 08 02:44:10.779780 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 8/17] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:09 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1315 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:11.482475 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-d8e4d385-969c-4d8f-829d-87d0191e69d4 req-464c4bd7-a8ad-4370-93f5-63ca702d3321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7abd5e4-0438-45c3-bad1-9779674a6e4b", "tag": "f0ff52a0-7fb7-43b6-a51f-a6b036a7209c"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:11.487739 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:44:11.487739 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:44:11.521754 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-d8e4d385-969c-4d8f-829d-87d0191e69d4 req-464c4bd7-a8ad-4370-93f5-63ca702d3321 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:11.538379 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-d8e4d385-969c-4d8f-829d-87d0191e69d4 req-464c4bd7-a8ad-4370-93f5-63ca702d3321 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:11.589969 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-d8e4d385-969c-4d8f-829d-87d0191e69d4 req-464c4bd7-a8ad-4370-93f5-63ca702d3321 service nova] Creating event network-changed:f0ff52a0-7fb7-43b6-a51f-a6b036a7209c for instance a7abd5e4-0438-45c3-bad1-9779674a6e4b on hv-cinder-83705 Apr 08 02:44:11.594225 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-d8e4d385-969c-4d8f-829d-87d0191e69d4 req-464c4bd7-a8ad-4370-93f5-63ca702d3321 service nova] Acquired lock "compute-rpcapi-router" {{(pid=101271) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 08 02:44:11.598132 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b0862696-592f-4686-a135-db53d98548db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:11.599473 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b0862696-592f-4686-a135-db53d98548db None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:11.600896 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b0862696-592f-4686-a135-db53d98548db None None] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:11.603171 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b0862696-592f-4686-a135-db53d98548db None None] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:11.639081 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.compute.rpcapi [None req-b0862696-592f-4686-a135-db53d98548db None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 08 02:44:11.649039 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b0862696-592f-4686-a135-db53d98548db None None] Releasing lock "compute-rpcapi-router" {{(pid=101271) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 08 02:44:11.696863 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b0862696-592f-4686-a135-db53d98548db None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.933160 Apr 08 02:44:11.698229 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:11.800278 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-df0ce47c-d575-436a-b079-778ef1ad3e0b tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:11.801528 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-df0ce47c-d575-436a-b079-778ef1ad3e0b tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:11.821417 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-df0ce47c-d575-436a-b079-778ef1ad3e0b tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:11.825055 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-df0ce47c-d575-436a-b079-778ef1ad3e0b tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:11.826059 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-df0ce47c-d575-436a-b079-778ef1ad3e0b tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:11.828448 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-df0ce47c-d575-436a-b079-778ef1ad3e0b tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:12.929769 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-df0ce47c-d575-436a-b079-778ef1ad3e0b tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:12.944459 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-df0ce47c-d575-436a-b079-778ef1ad3e0b tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1315 microversion: 2.1 time: 1.147736 Apr 08 02:44:12.950643 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 9/19] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:11 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1315 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:13.968906 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-30b29d77-6e41-404e-ac5f-4208b61ef789 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:13.969626 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-30b29d77-6e41-404e-ac5f-4208b61ef789 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:13.985061 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-30b29d77-6e41-404e-ac5f-4208b61ef789 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:13.985723 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-30b29d77-6e41-404e-ac5f-4208b61ef789 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:13.988442 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-30b29d77-6e41-404e-ac5f-4208b61ef789 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:13.989126 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-30b29d77-6e41-404e-ac5f-4208b61ef789 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:14.247657 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-a70b2544-1b6a-4aa9-9593-07afa9069ce2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1031493456", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f572796-aa3b-4385-be7e-dfaa12bb77ed"}], "security_groups": [{"name": "tempest-securitygroup--768794946"}], "key_name": "tempest-keypair-145837493", "user_data": "}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:14.930435 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.network.neutron [None req-a70b2544-1b6a-4aa9-9593-07afa9069ce2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] validate_networks() for [('7f572796-aa3b-4385-be7e-dfaa12bb77ed', None, None, None)] {{(pid=101272) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:44:15.573837 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-30b29d77-6e41-404e-ac5f-4208b61ef789 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:15.590476 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-30b29d77-6e41-404e-ac5f-4208b61ef789 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1315 microversion: 2.1 time: 1.626806 Apr 08 02:44:15.591541 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 11/20] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:13 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1315 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:16.013992 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-a70b2544-1b6a-4aa9-9593-07afa9069ce2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Flavor limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:44:16.015101 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-a70b2544-1b6a-4aa9-9593-07afa9069ce2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Image limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:44:16.015959 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-a70b2544-1b6a-4aa9-9593-07afa9069ce2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Flavor pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:44:16.016414 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-a70b2544-1b6a-4aa9-9593-07afa9069ce2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Image pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:44:16.016828 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-a70b2544-1b6a-4aa9-9593-07afa9069ce2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:44:16.031855 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a70b2544-1b6a-4aa9-9593-07afa9069ce2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:16.034484 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a70b2544-1b6a-4aa9-9593-07afa9069ce2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:16.035322 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a70b2544-1b6a-4aa9-9593-07afa9069ce2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:16.035756 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a70b2544-1b6a-4aa9-9593-07afa9069ce2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:16.085759 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-a70b2544-1b6a-4aa9-9593-07afa9069ce2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Getting quotas for project 688b5f689e3e41249484667a939fd5f8. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:44:16.094944 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-a70b2544-1b6a-4aa9-9593-07afa9069ce2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Getting quotas for user e8e3c70e491a4f0691f753c8e2b95e95 and project 688b5f689e3e41249484667a939fd5f8. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:44:16.131514 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-a70b2544-1b6a-4aa9-9593-07afa9069ce2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Going to run 1 instances... {{(pid=101272) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:44:16.133695 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-a70b2544-1b6a-4aa9-9593-07afa9069ce2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:44:16.213511 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-a70b2544-1b6a-4aa9-9593-07afa9069ce2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.970275 Apr 08 02:44:16.214758 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 10/21] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Apr 8 02:44:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 1972 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 08 02:44:16.224640 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b4eb924c-ef98-487c-a8d7-93acc645ef30 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:16.225250 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b4eb924c-ef98-487c-a8d7-93acc645ef30 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:16.443503 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b4eb924c-ef98-487c-a8d7-93acc645ef30 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:16.453416 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b4eb924c-ef98-487c-a8d7-93acc645ef30 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:16.468320 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b4eb924c-ef98-487c-a8d7-93acc645ef30 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:16.473419 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b4eb924c-ef98-487c-a8d7-93acc645ef30 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1281 microversion: 2.20 time: 0.252307 Apr 08 02:44:16.474273 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 11/22] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:16 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1281 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:44:16.526080 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-01dd3d30-8743-47a3-8dbd-1bd269d52f4c tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Action: 'create', calling method: .version_select at 0x7fbc3910e670>, body: {"keypair": {"name": "tempest-keypair-29480757"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:16.607766 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-aab8c472-5f52-4f68-87d1-2b4643992ef4 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:16.610954 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-aab8c472-5f52-4f68-87d1-2b4643992ef4 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:16.634165 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aab8c472-5f52-4f68-87d1-2b4643992ef4 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:16.634165 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aab8c472-5f52-4f68-87d1-2b4643992ef4 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:16.636463 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aab8c472-5f52-4f68-87d1-2b4643992ef4 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:16.637000 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aab8c472-5f52-4f68-87d1-2b4643992ef4 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:16.676359 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-01dd3d30-8743-47a3-8dbd-1bd269d52f4c tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Getting quotas for project 16870ad51e0f4d1d9d73d3922e34a632. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:44:16.694833 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-01dd3d30-8743-47a3-8dbd-1bd269d52f4c tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Getting quotas for user 008fc39c532a4a0ca8fc83e0d244a370 and project 16870ad51e0f4d1d9d73d3922e34a632. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:44:17.007719 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-01dd3d30-8743-47a3-8dbd-1bd269d52f4c tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Getting quotas for project 16870ad51e0f4d1d9d73d3922e34a632. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:44:17.024146 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-01dd3d30-8743-47a3-8dbd-1bd269d52f4c tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Getting quotas for user 008fc39c532a4a0ca8fc83e0d244a370 and project 16870ad51e0f4d1d9d73d3922e34a632. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:44:17.046892 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-01dd3d30-8743-47a3-8dbd-1bd269d52f4c tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 1.258747 Apr 08 02:44:17.050118 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 12/23] 10.222.0.23 () {60 vars in 1157 bytes} [Fri Apr 8 02:44:15 2022] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:17.079407 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-02e4470d-8d80-4a64-b249-ac26e2b888c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1194961364", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43b1983b-07c7-47cb-8ae4-f6d4398035b6"}], "security_groups": [{"name": "tempest-securitygroup--969433291"}], "key_name": "tempest-keypair-2051723958", "user_data": "}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:17.443017 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-aab8c472-5f52-4f68-87d1-2b4643992ef4 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:17.454443 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-aab8c472-5f52-4f68-87d1-2b4643992ef4 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1315 microversion: 2.1 time: 0.850365 Apr 08 02:44:17.455058 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:16 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1315 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:17.492986 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f27415ed-2518-4518-87d1-e6b0d120a40f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:17.493915 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f27415ed-2518-4518-87d1-e6b0d120a40f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:17.597842 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f27415ed-2518-4518-87d1-e6b0d120a40f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:17.606611 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f27415ed-2518-4518-87d1-e6b0d120a40f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:17.608245 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f27415ed-2518-4518-87d1-e6b0d120a40f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:17.609587 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f27415ed-2518-4518-87d1-e6b0d120a40f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1281 microversion: 2.20 time: 0.120750 Apr 08 02:44:17.612660 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 13/25] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:17 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1281 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:17.695445 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.network.neutron [None req-02e4470d-8d80-4a64-b249-ac26e2b888c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] validate_networks() for [('43b1983b-07c7-47cb-8ae4-f6d4398035b6', None, None, None)] {{(pid=101271) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:44:18.479007 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-8d7b5040-aff0-45c1-848f-a69f4b4afd42 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:18.480352 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-8d7b5040-aff0-45c1-848f-a69f4b4afd42 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:18.497304 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8d7b5040-aff0-45c1-848f-a69f4b4afd42 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:18.500176 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8d7b5040-aff0-45c1-848f-a69f4b4afd42 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:18.501231 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8d7b5040-aff0-45c1-848f-a69f4b4afd42 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:18.503536 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8d7b5040-aff0-45c1-848f-a69f4b4afd42 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:19.202298 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-8d7b5040-aff0-45c1-848f-a69f4b4afd42 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:19.212979 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-8d7b5040-aff0-45c1-848f-a69f4b4afd42 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1315 microversion: 2.1 time: 0.739944 Apr 08 02:44:19.213562 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 14/26] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:18 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1315 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:19.222602 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-79be566f-6aae-4243-94b2-4f6a698196bf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:19.223218 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-79be566f-6aae-4243-94b2-4f6a698196bf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:19.240071 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-79be566f-6aae-4243-94b2-4f6a698196bf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:19.240924 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-79be566f-6aae-4243-94b2-4f6a698196bf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:19.248337 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-79be566f-6aae-4243-94b2-4f6a698196bf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:19.249490 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-79be566f-6aae-4243-94b2-4f6a698196bf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:19.530984 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-79be566f-6aae-4243-94b2-4f6a698196bf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:19.542939 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-79be566f-6aae-4243-94b2-4f6a698196bf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:19.549928 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-79be566f-6aae-4243-94b2-4f6a698196bf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:19.554317 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-79be566f-6aae-4243-94b2-4f6a698196bf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1351 microversion: 2.20 time: 0.337699 Apr 08 02:44:19.555390 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 15/27] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:19 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1351 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:20.236814 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-55c20040-f224-425f-95e4-f1b7e33a92e9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:20.237427 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-55c20040-f224-425f-95e4-f1b7e33a92e9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:20.247803 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-55c20040-f224-425f-95e4-f1b7e33a92e9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:20.255167 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-55c20040-f224-425f-95e4-f1b7e33a92e9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:20.256067 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-55c20040-f224-425f-95e4-f1b7e33a92e9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:20.256676 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-55c20040-f224-425f-95e4-f1b7e33a92e9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:20.661140 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-55c20040-f224-425f-95e4-f1b7e33a92e9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:20.671318 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-55c20040-f224-425f-95e4-f1b7e33a92e9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1315 microversion: 2.1 time: 0.439852 Apr 08 02:44:20.672330 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 16/28] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:20 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:20.677396 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-8965ca49-bd17-4987-a52e-07175bc85d01 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:20.678617 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-8965ca49-bd17-4987-a52e-07175bc85d01 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:20.696126 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8965ca49-bd17-4987-a52e-07175bc85d01 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:20.696787 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8965ca49-bd17-4987-a52e-07175bc85d01 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:20.697818 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8965ca49-bd17-4987-a52e-07175bc85d01 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:20.698462 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8965ca49-bd17-4987-a52e-07175bc85d01 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:20.755538 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-02e4470d-8d80-4a64-b249-ac26e2b888c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Flavor limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:44:20.757779 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-02e4470d-8d80-4a64-b249-ac26e2b888c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Image limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:44:20.759197 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-02e4470d-8d80-4a64-b249-ac26e2b888c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Flavor pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:44:20.760577 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-02e4470d-8d80-4a64-b249-ac26e2b888c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Image pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:44:20.761619 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-02e4470d-8d80-4a64-b249-ac26e2b888c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:44:20.782404 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-02e4470d-8d80-4a64-b249-ac26e2b888c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:20.783128 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-02e4470d-8d80-4a64-b249-ac26e2b888c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:20.785270 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-02e4470d-8d80-4a64-b249-ac26e2b888c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:20.787546 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-02e4470d-8d80-4a64-b249-ac26e2b888c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:20.869835 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-02e4470d-8d80-4a64-b249-ac26e2b888c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:44:20.885554 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-02e4470d-8d80-4a64-b249-ac26e2b888c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for user 44a64fb1ebd9411eb6156c8ef97c3072 and project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:44:20.926938 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-02e4470d-8d80-4a64-b249-ac26e2b888c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Going to run 1 instances... {{(pid=101271) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:44:20.930055 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-02e4470d-8d80-4a64-b249-ac26e2b888c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:44:21.080091 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-8965ca49-bd17-4987-a52e-07175bc85d01 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:21.101623 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-8965ca49-bd17-4987-a52e-07175bc85d01 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:21.111099 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-8965ca49-bd17-4987-a52e-07175bc85d01 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:21.112253 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-8965ca49-bd17-4987-a52e-07175bc85d01 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1339 microversion: 2.20 time: 0.438752 Apr 08 02:44:21.114175 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 17/29] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:20 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1339 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:21.144893 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-02e4470d-8d80-4a64-b249-ac26e2b888c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.070311 Apr 08 02:44:21.150638 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 13/30] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:44:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 4072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:44:21.155917 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4ded169e-24ee-4f7d-a301-76c932f6abaf tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:21.156565 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4ded169e-24ee-4f7d-a301-76c932f6abaf tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:21.472635 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4ded169e-24ee-4f7d-a301-76c932f6abaf tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:21.484721 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-4ded169e-24ee-4f7d-a301-76c932f6abaf tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1242 microversion: 2.1 time: 0.332692 Apr 08 02:44:21.495738 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 18/31] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:21 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1242 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:21.696394 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d1aeac9b-0084-4e46-ba8e-8366aa8e17d2 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:21.698134 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-d1aeac9b-0084-4e46-ba8e-8366aa8e17d2 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:21.733658 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d1aeac9b-0084-4e46-ba8e-8366aa8e17d2 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:21.736560 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d1aeac9b-0084-4e46-ba8e-8366aa8e17d2 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:21.738108 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d1aeac9b-0084-4e46-ba8e-8366aa8e17d2 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:21.740890 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d1aeac9b-0084-4e46-ba8e-8366aa8e17d2 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:22.130241 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d40b6e77-51fb-4e02-a8a7-5009a36632e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:22.130853 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d40b6e77-51fb-4e02-a8a7-5009a36632e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:22.147839 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d40b6e77-51fb-4e02-a8a7-5009a36632e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:22.148315 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d40b6e77-51fb-4e02-a8a7-5009a36632e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:22.149088 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d40b6e77-51fb-4e02-a8a7-5009a36632e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:22.149521 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d40b6e77-51fb-4e02-a8a7-5009a36632e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:22.322532 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d40b6e77-51fb-4e02-a8a7-5009a36632e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:22.338838 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d40b6e77-51fb-4e02-a8a7-5009a36632e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:22.341872 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d40b6e77-51fb-4e02-a8a7-5009a36632e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:22.343887 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d40b6e77-51fb-4e02-a8a7-5009a36632e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1339 microversion: 2.20 time: 0.217418 Apr 08 02:44:22.345417 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 19/32] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:22 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1339 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:22.503441 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d530335f-f121-4de4-9860-36682396956a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:22.504807 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d530335f-f121-4de4-9860-36682396956a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:22.516283 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d530335f-f121-4de4-9860-36682396956a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:22.520740 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d530335f-f121-4de4-9860-36682396956a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:22.521909 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d530335f-f121-4de4-9860-36682396956a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:22.524492 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d530335f-f121-4de4-9860-36682396956a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:22.761878 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d530335f-f121-4de4-9860-36682396956a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:22.785615 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d530335f-f121-4de4-9860-36682396956a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1294 microversion: 2.1 time: 0.285475 Apr 08 02:44:22.788138 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 20/33] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:22 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1294 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:22.799201 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-d1aeac9b-0084-4e46-ba8e-8366aa8e17d2 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:22.822125 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-d1aeac9b-0084-4e46-ba8e-8366aa8e17d2 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1315 microversion: 2.1 time: 1.133410 Apr 08 02:44:22.825763 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 14/34] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:21 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1315 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:23.363081 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-a6b57879-76aa-46de-a5c7-87d033bed65c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:23.363760 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-a6b57879-76aa-46de-a5c7-87d033bed65c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:23.402014 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a6b57879-76aa-46de-a5c7-87d033bed65c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:23.405359 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a6b57879-76aa-46de-a5c7-87d033bed65c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:23.412246 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a6b57879-76aa-46de-a5c7-87d033bed65c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:23.412246 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a6b57879-76aa-46de-a5c7-87d033bed65c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:23.682750 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4a352528-dd22-4b09-afbc-202c8abe86f6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1524457838", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5edff82e-54bb-4c43-8c44-0c613d4c1fa9"}], "security_groups": [{"name": "tempest-securitygroup--795527128"}], "key_name": "tempest-keypair-29480757", "user_data": "}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:24.168778 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.network.neutron [None req-4a352528-dd22-4b09-afbc-202c8abe86f6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] validate_networks() for [('5edff82e-54bb-4c43-8c44-0c613d4c1fa9', None, None, None)] {{(pid=101271) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:44:24.229843 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a6b57879-76aa-46de-a5c7-87d033bed65c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:24.240706 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a6b57879-76aa-46de-a5c7-87d033bed65c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:24.242435 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a6b57879-76aa-46de-a5c7-87d033bed65c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:24.243544 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-a6b57879-76aa-46de-a5c7-87d033bed65c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1406 microversion: 2.20 time: 0.884857 Apr 08 02:44:24.255554 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 21/35] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:23 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1406 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:24.260406 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-cff7d214-41c8-42a2-a488-fba5dea09476 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:24.261233 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-cff7d214-41c8-42a2-a488-fba5dea09476 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:24.270707 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cff7d214-41c8-42a2-a488-fba5dea09476 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:24.271309 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cff7d214-41c8-42a2-a488-fba5dea09476 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:24.272349 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cff7d214-41c8-42a2-a488-fba5dea09476 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:24.272927 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cff7d214-41c8-42a2-a488-fba5dea09476 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:24.432218 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cff7d214-41c8-42a2-a488-fba5dea09476 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:24.463451 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-cff7d214-41c8-42a2-a488-fba5dea09476 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1300 microversion: 2.1 time: 0.205302 Apr 08 02:44:24.476592 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 22/36] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:24 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1300 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:24.484799 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d79e4f8f-c4da-4eb0-8481-6bd80a116c0d tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:24.486896 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d79e4f8f-c4da-4eb0-8481-6bd80a116c0d tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:24.509923 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d79e4f8f-c4da-4eb0-8481-6bd80a116c0d tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:24.510750 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d79e4f8f-c4da-4eb0-8481-6bd80a116c0d tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:24.512044 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d79e4f8f-c4da-4eb0-8481-6bd80a116c0d tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:24.515478 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d79e4f8f-c4da-4eb0-8481-6bd80a116c0d tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:25.130798 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d79e4f8f-c4da-4eb0-8481-6bd80a116c0d tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:25.142499 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d79e4f8f-c4da-4eb0-8481-6bd80a116c0d tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1315 microversion: 2.1 time: 0.671803 Apr 08 02:44:25.145548 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 23/37] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:24 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:25.516594 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-04f84727-9a74-409b-9953-daff252b8611 req-efeb3fe6-e596-4932-bdbf-9c94cc977696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7abd5e4-0438-45c3-bad1-9779674a6e4b", "name": "network-vif-plugged", "status": "completed", "tag": "f0ff52a0-7fb7-43b6-a51f-a6b036a7209c"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:25.518917 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:44:25.518917 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:44:25.538396 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-04f84727-9a74-409b-9953-daff252b8611 req-efeb3fe6-e596-4932-bdbf-9c94cc977696 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:25.538845 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-04f84727-9a74-409b-9953-daff252b8611 req-efeb3fe6-e596-4932-bdbf-9c94cc977696 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:25.584662 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-04f84727-9a74-409b-9953-daff252b8611 req-efeb3fe6-e596-4932-bdbf-9c94cc977696 service nova] Creating event network-vif-plugged:f0ff52a0-7fb7-43b6-a51f-a6b036a7209c for instance a7abd5e4-0438-45c3-bad1-9779674a6e4b on hv-cinder-83705 Apr 08 02:44:25.590590 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-04f84727-9a74-409b-9953-daff252b8611 req-efeb3fe6-e596-4932-bdbf-9c94cc977696 service nova] Acquired lock "compute-rpcapi-router" {{(pid=101272) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 08 02:44:25.592887 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8549561c-c6f6-4a14-9a36-2f534fed8efc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:25.593656 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8549561c-c6f6-4a14-9a36-2f534fed8efc None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:25.594965 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8549561c-c6f6-4a14-9a36-2f534fed8efc None None] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:25.595479 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8549561c-c6f6-4a14-9a36-2f534fed8efc None None] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:25.616364 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.compute.rpcapi [None req-8549561c-c6f6-4a14-9a36-2f534fed8efc None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 08 02:44:25.618328 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8549561c-c6f6-4a14-9a36-2f534fed8efc None None] Releasing lock "compute-rpcapi-router" {{(pid=101272) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 08 02:44:25.658756 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-8549561c-c6f6-4a14-9a36-2f534fed8efc None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.511682 Apr 08 02:44:25.659378 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 24/38] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:25.672434 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b6cec7f5-1698-48af-9b72-b9b38d9956ad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:25.673446 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b6cec7f5-1698-48af-9b72-b9b38d9956ad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:25.683337 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b6cec7f5-1698-48af-9b72-b9b38d9956ad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:25.684519 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b6cec7f5-1698-48af-9b72-b9b38d9956ad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:25.686053 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b6cec7f5-1698-48af-9b72-b9b38d9956ad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:25.702659 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b6cec7f5-1698-48af-9b72-b9b38d9956ad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:26.184158 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b6cec7f5-1698-48af-9b72-b9b38d9956ad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:26.198554 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b6cec7f5-1698-48af-9b72-b9b38d9956ad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:26.206422 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b6cec7f5-1698-48af-9b72-b9b38d9956ad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:26.207672 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b6cec7f5-1698-48af-9b72-b9b38d9956ad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1406 microversion: 2.20 time: 0.546914 Apr 08 02:44:26.218914 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 25/39] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:25 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1406 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:26.223744 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-58e229f9-b838-4a4d-bab6-d50db9baf28a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:26.224631 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-58e229f9-b838-4a4d-bab6-d50db9baf28a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:26.233495 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-58e229f9-b838-4a4d-bab6-d50db9baf28a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:26.234202 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-58e229f9-b838-4a4d-bab6-d50db9baf28a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:26.235325 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-58e229f9-b838-4a4d-bab6-d50db9baf28a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:26.235987 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-58e229f9-b838-4a4d-bab6-d50db9baf28a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:26.365718 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-4a352528-dd22-4b09-afbc-202c8abe86f6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Flavor limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:44:26.366918 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-4a352528-dd22-4b09-afbc-202c8abe86f6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Image limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:44:26.368047 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-4a352528-dd22-4b09-afbc-202c8abe86f6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Flavor pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:44:26.369427 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-4a352528-dd22-4b09-afbc-202c8abe86f6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Image pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:44:26.370479 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-4a352528-dd22-4b09-afbc-202c8abe86f6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:44:26.380247 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4a352528-dd22-4b09-afbc-202c8abe86f6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:26.381056 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4a352528-dd22-4b09-afbc-202c8abe86f6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:26.382113 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4a352528-dd22-4b09-afbc-202c8abe86f6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:26.382837 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4a352528-dd22-4b09-afbc-202c8abe86f6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:26.402181 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-4a352528-dd22-4b09-afbc-202c8abe86f6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Getting quotas for project 16870ad51e0f4d1d9d73d3922e34a632. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:44:26.407671 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-4a352528-dd22-4b09-afbc-202c8abe86f6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Getting quotas for user 008fc39c532a4a0ca8fc83e0d244a370 and project 16870ad51e0f4d1d9d73d3922e34a632. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:44:26.421351 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-4a352528-dd22-4b09-afbc-202c8abe86f6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Going to run 1 instances... {{(pid=101271) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:44:26.424341 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-4a352528-dd22-4b09-afbc-202c8abe86f6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:44:26.484677 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4a352528-dd22-4b09-afbc-202c8abe86f6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.807073 Apr 08 02:44:26.486207 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 15/40] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:44:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 2809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:44:26.492171 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-e3cf428c-a894-4f09-b445-9e82d6459f69 req-06ae1236-75fe-4463-a711-b2a1494fd45c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a1344c-2d91-4224-ab68-1898d4aa8b0f", "tag": "19d6323f-cbfa-4743-8474-008e1a45beee"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:26.494357 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:44:26.494357 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:44:26.506325 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-e3cf428c-a894-4f09-b445-9e82d6459f69 req-06ae1236-75fe-4463-a711-b2a1494fd45c service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:26.507131 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-e3cf428c-a894-4f09-b445-9e82d6459f69 req-06ae1236-75fe-4463-a711-b2a1494fd45c service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:26.534358 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-e3cf428c-a894-4f09-b445-9e82d6459f69 req-06ae1236-75fe-4463-a711-b2a1494fd45c service nova] Creating event network-changed:19d6323f-cbfa-4743-8474-008e1a45beee for instance 89a1344c-2d91-4224-ab68-1898d4aa8b0f on hv-cinder-83705 Apr 08 02:44:26.541300 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-e3cf428c-a894-4f09-b445-9e82d6459f69 req-06ae1236-75fe-4463-a711-b2a1494fd45c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053042 Apr 08 02:44:26.546336 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 16/41] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:26.551797 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1e1560b2-42d7-4211-b059-7c339f20c085 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:26.553278 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1e1560b2-42d7-4211-b059-7c339f20c085 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:26.562806 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1e1560b2-42d7-4211-b059-7c339f20c085 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:26.563718 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1e1560b2-42d7-4211-b059-7c339f20c085 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:26.564878 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1e1560b2-42d7-4211-b059-7c339f20c085 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:26.565676 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1e1560b2-42d7-4211-b059-7c339f20c085 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:26.833750 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1e1560b2-42d7-4211-b059-7c339f20c085 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:26.846297 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1e1560b2-42d7-4211-b059-7c339f20c085 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1315 microversion: 2.1 time: 0.298335 Apr 08 02:44:26.849958 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 17/42] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:26 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:26.863705 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-750c3ab1-be30-45fc-b10a-46386ea1915d tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:26.867236 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-750c3ab1-be30-45fc-b10a-46386ea1915d tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:27.011050 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-750c3ab1-be30-45fc-b10a-46386ea1915d tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:27.024988 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-750c3ab1-be30-45fc-b10a-46386ea1915d tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1236 microversion: 2.1 time: 0.173729 Apr 08 02:44:27.025910 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 18/43] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:26 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1236 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:27.070194 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-58e229f9-b838-4a4d-bab6-d50db9baf28a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:27.085286 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-58e229f9-b838-4a4d-bab6-d50db9baf28a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1367 microversion: 2.1 time: 0.864766 Apr 08 02:44:27.086434 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 26/44] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:26 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1367 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:27.226583 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4955ca6b-202f-4d1d-883e-79beff2bc450 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:27.227566 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-4955ca6b-202f-4d1d-883e-79beff2bc450 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:27.236916 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4955ca6b-202f-4d1d-883e-79beff2bc450 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:27.237513 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4955ca6b-202f-4d1d-883e-79beff2bc450 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:27.238426 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4955ca6b-202f-4d1d-883e-79beff2bc450 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:27.238959 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4955ca6b-202f-4d1d-883e-79beff2bc450 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:27.429675 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-bc4e614f-b498-4fa0-889a-f72b11b9bdab req-e0fa8869-7771-4d93-b565-209eb0afc53b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7ae39c8-31a8-4fff-854c-06275d09d237", "tag": "823fa2cc-3d06-401c-8c4e-211154f6e79b"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:27.431412 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:44:27.431412 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:44:27.439537 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-bc4e614f-b498-4fa0-889a-f72b11b9bdab req-e0fa8869-7771-4d93-b565-209eb0afc53b service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:27.440024 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-bc4e614f-b498-4fa0-889a-f72b11b9bdab req-e0fa8869-7771-4d93-b565-209eb0afc53b service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:27.464219 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-bc4e614f-b498-4fa0-889a-f72b11b9bdab req-e0fa8869-7771-4d93-b565-209eb0afc53b service nova] Creating event network-changed:823fa2cc-3d06-401c-8c4e-211154f6e79b for instance d7ae39c8-31a8-4fff-854c-06275d09d237 on hv-cinder-83705 Apr 08 02:44:27.474546 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-bc4e614f-b498-4fa0-889a-f72b11b9bdab req-e0fa8869-7771-4d93-b565-209eb0afc53b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191535 Apr 08 02:44:27.483468 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 27/45] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:27.626360 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4955ca6b-202f-4d1d-883e-79beff2bc450 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:27.640455 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4955ca6b-202f-4d1d-883e-79beff2bc450 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:27.642976 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4955ca6b-202f-4d1d-883e-79beff2bc450 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:27.644873 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4955ca6b-202f-4d1d-883e-79beff2bc450 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1406 microversion: 2.20 time: 0.421803 Apr 08 02:44:27.646405 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 19/46] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:27 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:27.865300 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0ec171dc-4532-4bb9-a591-8c0ade612b0a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:27.866000 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0ec171dc-4532-4bb9-a591-8c0ade612b0a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:27.873720 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0ec171dc-4532-4bb9-a591-8c0ade612b0a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:27.874166 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0ec171dc-4532-4bb9-a591-8c0ade612b0a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:27.875136 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0ec171dc-4532-4bb9-a591-8c0ade612b0a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:27.875731 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0ec171dc-4532-4bb9-a591-8c0ade612b0a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:28.052854 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a188e062-c4e2-4c81-b9e2-3c6cbb1971e8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:28.054117 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a188e062-c4e2-4c81-b9e2-3c6cbb1971e8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:28.071850 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a188e062-c4e2-4c81-b9e2-3c6cbb1971e8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:28.072484 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a188e062-c4e2-4c81-b9e2-3c6cbb1971e8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:28.073620 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a188e062-c4e2-4c81-b9e2-3c6cbb1971e8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:28.074128 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a188e062-c4e2-4c81-b9e2-3c6cbb1971e8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:28.163985 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0ec171dc-4532-4bb9-a591-8c0ade612b0a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:28.180877 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0ec171dc-4532-4bb9-a591-8c0ade612b0a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1315 microversion: 2.1 time: 0.319601 Apr 08 02:44:28.181833 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 28/47] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:27 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:28.196713 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5f2a7e18-83c1-457f-808d-2034f9c98ea5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:28.198780 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5f2a7e18-83c1-457f-808d-2034f9c98ea5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:28.208149 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a188e062-c4e2-4c81-b9e2-3c6cbb1971e8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:28.209039 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5f2a7e18-83c1-457f-808d-2034f9c98ea5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:28.209492 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5f2a7e18-83c1-457f-808d-2034f9c98ea5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:28.210454 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5f2a7e18-83c1-457f-808d-2034f9c98ea5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:28.210898 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5f2a7e18-83c1-457f-808d-2034f9c98ea5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:28.220261 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a188e062-c4e2-4c81-b9e2-3c6cbb1971e8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1240 microversion: 2.1 time: 0.177983 Apr 08 02:44:28.221327 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 20/48] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:28 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1240 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:28.549293 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5f2a7e18-83c1-457f-808d-2034f9c98ea5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:28.559475 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5f2a7e18-83c1-457f-808d-2034f9c98ea5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1367 microversion: 2.1 time: 0.366213 Apr 08 02:44:28.569150 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 29/49] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:28 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:28.663768 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c124d126-d512-4fae-b12f-ab2de82e4a18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:28.664410 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c124d126-d512-4fae-b12f-ab2de82e4a18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:28.672643 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c124d126-d512-4fae-b12f-ab2de82e4a18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:28.673094 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c124d126-d512-4fae-b12f-ab2de82e4a18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:28.673876 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c124d126-d512-4fae-b12f-ab2de82e4a18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:28.674314 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c124d126-d512-4fae-b12f-ab2de82e4a18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:29.025853 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c124d126-d512-4fae-b12f-ab2de82e4a18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:29.037936 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c124d126-d512-4fae-b12f-ab2de82e4a18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:29.039645 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c124d126-d512-4fae-b12f-ab2de82e4a18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:29.040851 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c124d126-d512-4fae-b12f-ab2de82e4a18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1406 microversion: 2.20 time: 0.380908 Apr 08 02:44:29.041679 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 21/50] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:28 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1406 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:29.198413 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3392bd32-a34f-48dc-9509-fba76f0bc268 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:29.199744 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-3392bd32-a34f-48dc-9509-fba76f0bc268 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:29.209408 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3392bd32-a34f-48dc-9509-fba76f0bc268 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:29.210129 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3392bd32-a34f-48dc-9509-fba76f0bc268 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:29.211060 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3392bd32-a34f-48dc-9509-fba76f0bc268 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:29.211504 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3392bd32-a34f-48dc-9509-fba76f0bc268 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:29.239354 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a0617e82-99dd-41bf-8197-89873b8fab10 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:29.240318 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a0617e82-99dd-41bf-8197-89873b8fab10 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:29.252323 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a0617e82-99dd-41bf-8197-89873b8fab10 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:29.256569 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a0617e82-99dd-41bf-8197-89873b8fab10 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:29.257527 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a0617e82-99dd-41bf-8197-89873b8fab10 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:29.258108 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a0617e82-99dd-41bf-8197-89873b8fab10 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:29.419033 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a0617e82-99dd-41bf-8197-89873b8fab10 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:29.428674 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a0617e82-99dd-41bf-8197-89873b8fab10 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1240 microversion: 2.1 time: 0.192982 Apr 08 02:44:29.437025 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 22/51] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:29 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1240 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:29.483379 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-3392bd32-a34f-48dc-9509-fba76f0bc268 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:29.493729 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3392bd32-a34f-48dc-9509-fba76f0bc268 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1315 microversion: 2.1 time: 0.299178 Apr 08 02:44:29.494340 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 30/52] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:29 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:29.575382 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-bda718ed-4167-4c57-9255-99d9ab23ba0d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:29.577069 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-bda718ed-4167-4c57-9255-99d9ab23ba0d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:29.584391 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-bda718ed-4167-4c57-9255-99d9ab23ba0d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:29.584844 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-bda718ed-4167-4c57-9255-99d9ab23ba0d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:29.585607 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-bda718ed-4167-4c57-9255-99d9ab23ba0d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:29.586040 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-bda718ed-4167-4c57-9255-99d9ab23ba0d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:29.858274 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-bda718ed-4167-4c57-9255-99d9ab23ba0d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:29.866946 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-bda718ed-4167-4c57-9255-99d9ab23ba0d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1367 microversion: 2.1 time: 0.295375 Apr 08 02:44:29.867984 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 23/53] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:29 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:44:30.061569 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-cf2df861-3fae-4d04-b8a7-9c59e835e8ec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:30.062568 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-cf2df861-3fae-4d04-b8a7-9c59e835e8ec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:30.079023 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cf2df861-3fae-4d04-b8a7-9c59e835e8ec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:30.081642 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cf2df861-3fae-4d04-b8a7-9c59e835e8ec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:30.084038 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cf2df861-3fae-4d04-b8a7-9c59e835e8ec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:30.084849 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cf2df861-3fae-4d04-b8a7-9c59e835e8ec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:30.456626 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-da672520-3ec2-460f-b247-313a366f880e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:30.457400 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-da672520-3ec2-460f-b247-313a366f880e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:30.482714 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-da672520-3ec2-460f-b247-313a366f880e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:30.483674 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-da672520-3ec2-460f-b247-313a366f880e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:30.486181 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-da672520-3ec2-460f-b247-313a366f880e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:30.488194 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-da672520-3ec2-460f-b247-313a366f880e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:30.807452 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-da672520-3ec2-460f-b247-313a366f880e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:30.816530 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-da672520-3ec2-460f-b247-313a366f880e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1288 microversion: 2.1 time: 0.373528 Apr 08 02:44:30.820493 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 24/54] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:30 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1288 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:44:30.836853 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c8be0895-ca7c-4e12-9c72-0b61165aecc1 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:30.837560 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c8be0895-ca7c-4e12-9c72-0b61165aecc1 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:30.854587 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c8be0895-ca7c-4e12-9c72-0b61165aecc1 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:30.854587 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c8be0895-ca7c-4e12-9c72-0b61165aecc1 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:30.854587 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c8be0895-ca7c-4e12-9c72-0b61165aecc1 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:30.854969 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c8be0895-ca7c-4e12-9c72-0b61165aecc1 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:30.998971 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cf2df861-3fae-4d04-b8a7-9c59e835e8ec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:31.014442 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cf2df861-3fae-4d04-b8a7-9c59e835e8ec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:31.018971 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cf2df861-3fae-4d04-b8a7-9c59e835e8ec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:31.021321 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-cf2df861-3fae-4d04-b8a7-9c59e835e8ec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1406 microversion: 2.20 time: 0.964437 Apr 08 02:44:31.023172 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 31/55] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:30 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1406 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:31.034728 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b67f0aab-db6c-4569-812d-3d68bc991521 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:31.038486 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b67f0aab-db6c-4569-812d-3d68bc991521 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:31.054357 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b67f0aab-db6c-4569-812d-3d68bc991521 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:31.055003 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b67f0aab-db6c-4569-812d-3d68bc991521 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:31.058742 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b67f0aab-db6c-4569-812d-3d68bc991521 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:31.061099 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b67f0aab-db6c-4569-812d-3d68bc991521 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:31.389646 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c8be0895-ca7c-4e12-9c72-0b61165aecc1 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:31.406234 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c8be0895-ca7c-4e12-9c72-0b61165aecc1 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1315 microversion: 2.1 time: 0.576630 Apr 08 02:44:31.407212 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 25/56] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:30 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:31.839770 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-6fb276ea-1ce1-410f-afcb-dfd6cfd85391 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:31.840455 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-6fb276ea-1ce1-410f-afcb-dfd6cfd85391 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:31.858675 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6fb276ea-1ce1-410f-afcb-dfd6cfd85391 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:31.859152 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6fb276ea-1ce1-410f-afcb-dfd6cfd85391 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:31.861078 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6fb276ea-1ce1-410f-afcb-dfd6cfd85391 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:31.861704 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6fb276ea-1ce1-410f-afcb-dfd6cfd85391 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:32.081163 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b67f0aab-db6c-4569-812d-3d68bc991521 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:32.094749 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b67f0aab-db6c-4569-812d-3d68bc991521 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1367 microversion: 2.1 time: 1.070485 Apr 08 02:44:32.098699 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 32/57] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:31 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1367 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:32.109259 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-bfafc9e1-6740-4564-b7ed-014caaa3e2a7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:32.110333 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-bfafc9e1-6740-4564-b7ed-014caaa3e2a7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:32.130377 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bfafc9e1-6740-4564-b7ed-014caaa3e2a7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:32.131498 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bfafc9e1-6740-4564-b7ed-014caaa3e2a7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:32.132477 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bfafc9e1-6740-4564-b7ed-014caaa3e2a7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:32.133095 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bfafc9e1-6740-4564-b7ed-014caaa3e2a7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:32.259865 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-6fb276ea-1ce1-410f-afcb-dfd6cfd85391 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:32.272524 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-6fb276ea-1ce1-410f-afcb-dfd6cfd85391 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1294 microversion: 2.1 time: 0.436379 Apr 08 02:44:32.273723 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 26/58] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:31 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1294 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:32.424647 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-31dc5866-d7e1-4637-afe9-c9d9180f942e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:32.426038 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-31dc5866-d7e1-4637-afe9-c9d9180f942e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:32.430692 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-bfafc9e1-6740-4564-b7ed-014caaa3e2a7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:32.449279 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-bfafc9e1-6740-4564-b7ed-014caaa3e2a7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:32.449279 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-bfafc9e1-6740-4564-b7ed-014caaa3e2a7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:32.449279 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-bfafc9e1-6740-4564-b7ed-014caaa3e2a7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1406 microversion: 2.20 time: 0.344028 Apr 08 02:44:32.449815 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 33/59] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:32 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1406 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:32.483114 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-31dc5866-d7e1-4637-afe9-c9d9180f942e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:32.483897 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-31dc5866-d7e1-4637-afe9-c9d9180f942e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:32.484934 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-31dc5866-d7e1-4637-afe9-c9d9180f942e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:32.485522 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-31dc5866-d7e1-4637-afe9-c9d9180f942e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:33.115120 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2e2217df-5817-4451-ba56-50d371ca4565 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:33.115847 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2e2217df-5817-4451-ba56-50d371ca4565 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:33.128067 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2e2217df-5817-4451-ba56-50d371ca4565 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:33.128456 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2e2217df-5817-4451-ba56-50d371ca4565 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:33.131392 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2e2217df-5817-4451-ba56-50d371ca4565 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:33.132019 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2e2217df-5817-4451-ba56-50d371ca4565 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:33.133705 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-31dc5866-d7e1-4637-afe9-c9d9180f942e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:33.150694 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-31dc5866-d7e1-4637-afe9-c9d9180f942e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1315 microversion: 2.1 time: 0.730638 Apr 08 02:44:33.152220 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 27/60] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:32 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1315 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:33.291740 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e4a4c56a-0456-4ee2-b57f-60129b469cf0 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:33.293529 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e4a4c56a-0456-4ee2-b57f-60129b469cf0 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:33.304813 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e4a4c56a-0456-4ee2-b57f-60129b469cf0 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:33.306220 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e4a4c56a-0456-4ee2-b57f-60129b469cf0 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:33.308112 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e4a4c56a-0456-4ee2-b57f-60129b469cf0 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:33.308781 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e4a4c56a-0456-4ee2-b57f-60129b469cf0 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:33.711569 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2e2217df-5817-4451-ba56-50d371ca4565 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:33.721025 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2e2217df-5817-4451-ba56-50d371ca4565 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1367 microversion: 2.1 time: 0.609854 Apr 08 02:44:33.725523 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 34/61] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:33 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1367 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:44:33.738081 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4a566672-ad1d-4e34-ac8b-3bbebc410d44 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:33.738970 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4a566672-ad1d-4e34-ac8b-3bbebc410d44 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:33.762290 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4a566672-ad1d-4e34-ac8b-3bbebc410d44 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:33.763069 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4a566672-ad1d-4e34-ac8b-3bbebc410d44 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:33.764132 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4a566672-ad1d-4e34-ac8b-3bbebc410d44 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:33.765011 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4a566672-ad1d-4e34-ac8b-3bbebc410d44 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:34.055514 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e4a4c56a-0456-4ee2-b57f-60129b469cf0 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:34.066193 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e4a4c56a-0456-4ee2-b57f-60129b469cf0 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1361 microversion: 2.1 time: 0.779679 Apr 08 02:44:34.067166 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 28/62] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:33 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1361 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:34.085815 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4a566672-ad1d-4e34-ac8b-3bbebc410d44 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:34.098036 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4a566672-ad1d-4e34-ac8b-3bbebc410d44 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:34.102001 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4a566672-ad1d-4e34-ac8b-3bbebc410d44 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:34.105514 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-4a566672-ad1d-4e34-ac8b-3bbebc410d44 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1406 microversion: 2.20 time: 0.378614 Apr 08 02:44:34.117290 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 35/63] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:33 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:34.166895 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-38f8bcdc-2de1-4490-bfa4-3d32632ae05c tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:34.167524 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-38f8bcdc-2de1-4490-bfa4-3d32632ae05c tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:34.181152 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-38f8bcdc-2de1-4490-bfa4-3d32632ae05c tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:34.181620 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-38f8bcdc-2de1-4490-bfa4-3d32632ae05c tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:34.183301 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-38f8bcdc-2de1-4490-bfa4-3d32632ae05c tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:34.183756 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-38f8bcdc-2de1-4490-bfa4-3d32632ae05c tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:34.622888 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-38f8bcdc-2de1-4490-bfa4-3d32632ae05c tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:34.633032 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-38f8bcdc-2de1-4490-bfa4-3d32632ae05c tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1315 microversion: 2.1 time: 0.470145 Apr 08 02:44:34.634799 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 29/64] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:34 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:34.742987 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1608d668-a768-427d-a26b-78e0d6a6203c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:34.744018 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1608d668-a768-427d-a26b-78e0d6a6203c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:34.762983 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1608d668-a768-427d-a26b-78e0d6a6203c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:34.764366 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1608d668-a768-427d-a26b-78e0d6a6203c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:34.767144 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1608d668-a768-427d-a26b-78e0d6a6203c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:34.767914 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1608d668-a768-427d-a26b-78e0d6a6203c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:35.084074 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-091faf41-5e62-4456-8d41-18eec4cff4ec tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:35.084702 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-091faf41-5e62-4456-8d41-18eec4cff4ec tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:35.109229 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-091faf41-5e62-4456-8d41-18eec4cff4ec tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:35.109229 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-091faf41-5e62-4456-8d41-18eec4cff4ec tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:35.109229 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-091faf41-5e62-4456-8d41-18eec4cff4ec tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:35.113724 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-091faf41-5e62-4456-8d41-18eec4cff4ec tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:35.281347 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1608d668-a768-427d-a26b-78e0d6a6203c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:35.291124 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1608d668-a768-427d-a26b-78e0d6a6203c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1367 microversion: 2.1 time: 0.552189 Apr 08 02:44:35.296101 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 36/65] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:34 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1367 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:35.301372 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-42fae2ca-637a-4d77-8607-9cf910471c81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:35.302017 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-42fae2ca-637a-4d77-8607-9cf910471c81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:35.311106 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-42fae2ca-637a-4d77-8607-9cf910471c81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:35.311780 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-42fae2ca-637a-4d77-8607-9cf910471c81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:35.312600 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-42fae2ca-637a-4d77-8607-9cf910471c81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:35.313030 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-42fae2ca-637a-4d77-8607-9cf910471c81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:35.585442 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-42fae2ca-637a-4d77-8607-9cf910471c81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:35.598077 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-42fae2ca-637a-4d77-8607-9cf910471c81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:35.599658 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-42fae2ca-637a-4d77-8607-9cf910471c81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:35.600783 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-42fae2ca-637a-4d77-8607-9cf910471c81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1406 microversion: 2.20 time: 0.303379 Apr 08 02:44:35.601564 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 37/66] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:35 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:35.606284 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-d5ea1d83-537c-4105-b6d8-8d54f5ad7683 req-c818d2ed-feeb-4833-bfbe-cf697666e93b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff7e510d-5c97-4291-930a-66cd4b8d6137", "tag": "0ed67e44-5f92-4862-acd5-9fec0333c514"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:35.609145 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:44:35.609145 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:44:35.618647 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-d5ea1d83-537c-4105-b6d8-8d54f5ad7683 req-c818d2ed-feeb-4833-bfbe-cf697666e93b service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:35.619174 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-d5ea1d83-537c-4105-b6d8-8d54f5ad7683 req-c818d2ed-feeb-4833-bfbe-cf697666e93b service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:35.637151 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-d5ea1d83-537c-4105-b6d8-8d54f5ad7683 req-c818d2ed-feeb-4833-bfbe-cf697666e93b service nova] Creating event network-changed:0ed67e44-5f92-4862-acd5-9fec0333c514 for instance ff7e510d-5c97-4291-930a-66cd4b8d6137 on hv-cinder-83705 Apr 08 02:44:35.643089 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-d5ea1d83-537c-4105-b6d8-8d54f5ad7683 req-c818d2ed-feeb-4833-bfbe-cf697666e93b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040220 Apr 08 02:44:35.643953 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 38/67] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:35.652332 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-66e1f335-d921-46b8-9cf0-5ce2ee795dab tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:35.653234 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-66e1f335-d921-46b8-9cf0-5ce2ee795dab tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:35.664277 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-66e1f335-d921-46b8-9cf0-5ce2ee795dab tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:35.665069 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-66e1f335-d921-46b8-9cf0-5ce2ee795dab tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:35.666094 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-66e1f335-d921-46b8-9cf0-5ce2ee795dab tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:35.666889 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-66e1f335-d921-46b8-9cf0-5ce2ee795dab tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:35.728879 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-091faf41-5e62-4456-8d41-18eec4cff4ec tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:35.744809 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-091faf41-5e62-4456-8d41-18eec4cff4ec tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1361 microversion: 2.1 time: 0.664737 Apr 08 02:44:35.746612 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 30/68] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:35 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1361 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:35.994185 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-66e1f335-d921-46b8-9cf0-5ce2ee795dab tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:36.002925 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-66e1f335-d921-46b8-9cf0-5ce2ee795dab tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1500 microversion: 2.1 time: 0.355476 Apr 08 02:44:36.003492 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 39/69] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:35 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1500 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:44:36.312219 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1f53616b-1c09-4841-baf0-4cbfbe71dca0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:36.314132 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1f53616b-1c09-4841-baf0-4cbfbe71dca0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:36.328782 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1f53616b-1c09-4841-baf0-4cbfbe71dca0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:36.330829 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1f53616b-1c09-4841-baf0-4cbfbe71dca0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:36.344789 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1f53616b-1c09-4841-baf0-4cbfbe71dca0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:36.344789 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1f53616b-1c09-4841-baf0-4cbfbe71dca0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:36.619618 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4e2e598a-bbd2-463d-a24a-a3b5c4a875ef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:36.620348 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4e2e598a-bbd2-463d-a24a-a3b5c4a875ef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:36.636336 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4e2e598a-bbd2-463d-a24a-a3b5c4a875ef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:36.637727 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4e2e598a-bbd2-463d-a24a-a3b5c4a875ef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:36.640132 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4e2e598a-bbd2-463d-a24a-a3b5c4a875ef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:36.641477 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4e2e598a-bbd2-463d-a24a-a3b5c4a875ef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:36.925214 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1f53616b-1c09-4841-baf0-4cbfbe71dca0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:36.947267 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1f53616b-1c09-4841-baf0-4cbfbe71dca0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1367 microversion: 2.1 time: 0.637907 Apr 08 02:44:36.952018 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 31/70] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:36 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1367 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:36.962694 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-0c49c3f1-2572-458e-9728-ee9acac04e65 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:36.963329 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-0c49c3f1-2572-458e-9728-ee9acac04e65 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:36.993545 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0c49c3f1-2572-458e-9728-ee9acac04e65 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:36.994009 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0c49c3f1-2572-458e-9728-ee9acac04e65 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:36.995149 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0c49c3f1-2572-458e-9728-ee9acac04e65 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:36.995271 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0c49c3f1-2572-458e-9728-ee9acac04e65 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:37.106054 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4e2e598a-bbd2-463d-a24a-a3b5c4a875ef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:37.118479 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4e2e598a-bbd2-463d-a24a-a3b5c4a875ef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:37.119801 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4e2e598a-bbd2-463d-a24a-a3b5c4a875ef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:37.120915 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-4e2e598a-bbd2-463d-a24a-a3b5c4a875ef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1406 microversion: 2.20 time: 0.506207 Apr 08 02:44:37.135950 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 40/71] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:36 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1406 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:37.554379 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0c49c3f1-2572-458e-9728-ee9acac04e65 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:37.567225 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-0c49c3f1-2572-458e-9728-ee9acac04e65 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1361 microversion: 2.1 time: 0.613994 Apr 08 02:44:37.585442 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 32/72] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:36 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1361 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:37.831728 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-7d7c6df8-f807-4be3-b0a2-6a20bfcf8434 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59b96282-efaa-472e-b6f7-30b7dc25c96a"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:37.833556 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-7d7c6df8-f807-4be3-b0a2-6a20bfcf8434 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:37.842278 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7d7c6df8-f807-4be3-b0a2-6a20bfcf8434 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:37.843136 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7d7c6df8-f807-4be3-b0a2-6a20bfcf8434 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:37.844250 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7d7c6df8-f807-4be3-b0a2-6a20bfcf8434 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:37.845559 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7d7c6df8-f807-4be3-b0a2-6a20bfcf8434 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:37.968204 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c2738892-7adf-49e7-a826-c437c9e01072 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:37.969029 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c2738892-7adf-49e7-a826-c437c9e01072 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:37.977634 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c2738892-7adf-49e7-a826-c437c9e01072 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:37.978310 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c2738892-7adf-49e7-a826-c437c9e01072 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:37.979297 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c2738892-7adf-49e7-a826-c437c9e01072 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:37.979979 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c2738892-7adf-49e7-a826-c437c9e01072 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:38.312020 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c2738892-7adf-49e7-a826-c437c9e01072 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:38.322131 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c2738892-7adf-49e7-a826-c437c9e01072 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1367 microversion: 2.1 time: 0.360080 Apr 08 02:44:38.327362 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 33/73] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:37 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:38.339537 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-554818d4-0a7c-4c2f-8398-606f1ae994c5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:38.342943 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-554818d4-0a7c-4c2f-8398-606f1ae994c5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:38.356803 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-554818d4-0a7c-4c2f-8398-606f1ae994c5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:38.358398 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-554818d4-0a7c-4c2f-8398-606f1ae994c5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:38.359532 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-554818d4-0a7c-4c2f-8398-606f1ae994c5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:38.360062 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-554818d4-0a7c-4c2f-8398-606f1ae994c5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:38.539044 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-7d7c6df8-f807-4be3-b0a2-6a20bfcf8434 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "POST /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.711245 Apr 08 02:44:38.540389 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 41/74] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Apr 8 02:44:37 2022] POST /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:38.586932 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ffb13ced-2a31-4679-8e7a-903ad6f7a55f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:38.587892 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ffb13ced-2a31-4679-8e7a-903ad6f7a55f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:38.604787 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ffb13ced-2a31-4679-8e7a-903ad6f7a55f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:38.605381 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ffb13ced-2a31-4679-8e7a-903ad6f7a55f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:38.606477 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ffb13ced-2a31-4679-8e7a-903ad6f7a55f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:38.607425 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ffb13ced-2a31-4679-8e7a-903ad6f7a55f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:38.740940 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-554818d4-0a7c-4c2f-8398-606f1ae994c5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:38.753387 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-554818d4-0a7c-4c2f-8398-606f1ae994c5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:38.755289 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-554818d4-0a7c-4c2f-8398-606f1ae994c5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:38.756463 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-554818d4-0a7c-4c2f-8398-606f1ae994c5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1406 microversion: 2.20 time: 0.427393 Apr 08 02:44:38.757029 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 34/75] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:38 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1406 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:38.958472 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ffb13ced-2a31-4679-8e7a-903ad6f7a55f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:38.969442 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ffb13ced-2a31-4679-8e7a-903ad6f7a55f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1361 microversion: 2.1 time: 0.387854 Apr 08 02:44:38.970184 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 42/76] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:38 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1361 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:44:39.344366 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-19b999aa-5ceb-4927-9cfe-9d824f401819 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:39.345066 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-19b999aa-5ceb-4927-9cfe-9d824f401819 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:39.352351 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-19b999aa-5ceb-4927-9cfe-9d824f401819 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:39.352867 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-19b999aa-5ceb-4927-9cfe-9d824f401819 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:39.353800 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-19b999aa-5ceb-4927-9cfe-9d824f401819 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:39.354300 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-19b999aa-5ceb-4927-9cfe-9d824f401819 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:39.572322 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-19b999aa-5ceb-4927-9cfe-9d824f401819 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:39.581943 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-19b999aa-5ceb-4927-9cfe-9d824f401819 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1367 microversion: 2.1 time: 0.241982 Apr 08 02:44:39.582506 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 35/77] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:39 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:39.777946 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-94b68299-7596-4bb7-8404-4ba38adc3137 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:39.778602 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-94b68299-7596-4bb7-8404-4ba38adc3137 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:39.787035 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-94b68299-7596-4bb7-8404-4ba38adc3137 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:39.787487 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-94b68299-7596-4bb7-8404-4ba38adc3137 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:39.788284 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-94b68299-7596-4bb7-8404-4ba38adc3137 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:39.788722 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-94b68299-7596-4bb7-8404-4ba38adc3137 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:39.986894 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-358b4b21-a179-414a-9f0e-4a8eff01c09b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:39.987666 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-358b4b21-a179-414a-9f0e-4a8eff01c09b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:40.002113 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-358b4b21-a179-414a-9f0e-4a8eff01c09b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:40.002712 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-358b4b21-a179-414a-9f0e-4a8eff01c09b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:40.003519 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-358b4b21-a179-414a-9f0e-4a8eff01c09b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:40.008327 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-358b4b21-a179-414a-9f0e-4a8eff01c09b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:40.170255 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-94b68299-7596-4bb7-8404-4ba38adc3137 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:40.185890 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-94b68299-7596-4bb7-8404-4ba38adc3137 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:40.188609 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-94b68299-7596-4bb7-8404-4ba38adc3137 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:40.191627 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-94b68299-7596-4bb7-8404-4ba38adc3137 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1406 microversion: 2.20 time: 0.415897 Apr 08 02:44:40.192701 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 43/78] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:39 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1406 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:40.277966 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-358b4b21-a179-414a-9f0e-4a8eff01c09b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:40.286937 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-358b4b21-a179-414a-9f0e-4a8eff01c09b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1361 microversion: 2.1 time: 0.303837 Apr 08 02:44:40.287677 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 36/79] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:39 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1361 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:44:40.598599 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-16e53478-3c19-4467-95a1-7c24abb1dcb7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:40.599204 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-16e53478-3c19-4467-95a1-7c24abb1dcb7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:40.606750 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-16e53478-3c19-4467-95a1-7c24abb1dcb7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:40.607713 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-16e53478-3c19-4467-95a1-7c24abb1dcb7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:40.608498 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-16e53478-3c19-4467-95a1-7c24abb1dcb7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:40.608923 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-16e53478-3c19-4467-95a1-7c24abb1dcb7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:40.898771 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-16e53478-3c19-4467-95a1-7c24abb1dcb7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:40.910885 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-16e53478-3c19-4467-95a1-7c24abb1dcb7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1367 microversion: 2.1 time: 0.315992 Apr 08 02:44:40.911466 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 44/80] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:40 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:41.146886 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-5b34d719-2d77-4a0e-a4f1-8d2d99c4d746 req-eff1d4b6-1f16-489c-a895-8db276579d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a1344c-2d91-4224-ab68-1898d4aa8b0f", "name": "network-vif-plugged", "status": "completed", "tag": "19d6323f-cbfa-4743-8474-008e1a45beee"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:41.149304 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:44:41.149304 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:44:41.172605 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-5b34d719-2d77-4a0e-a4f1-8d2d99c4d746 req-eff1d4b6-1f16-489c-a895-8db276579d2d service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:41.173043 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-5b34d719-2d77-4a0e-a4f1-8d2d99c4d746 req-eff1d4b6-1f16-489c-a895-8db276579d2d service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:41.198238 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-5b34d719-2d77-4a0e-a4f1-8d2d99c4d746 req-eff1d4b6-1f16-489c-a895-8db276579d2d service nova] Creating event network-vif-plugged:19d6323f-cbfa-4743-8474-008e1a45beee for instance 89a1344c-2d91-4224-ab68-1898d4aa8b0f on hv-cinder-83705 Apr 08 02:44:41.205318 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-5b34d719-2d77-4a0e-a4f1-8d2d99c4d746 req-eff1d4b6-1f16-489c-a895-8db276579d2d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063899 Apr 08 02:44:41.206774 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 37/81] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:41.211300 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-25cf4921-0e04-4db0-9042-e303b1ab288e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:41.212096 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-25cf4921-0e04-4db0-9042-e303b1ab288e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:41.221913 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-25cf4921-0e04-4db0-9042-e303b1ab288e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:41.222623 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-25cf4921-0e04-4db0-9042-e303b1ab288e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:41.223733 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-25cf4921-0e04-4db0-9042-e303b1ab288e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:41.226128 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-25cf4921-0e04-4db0-9042-e303b1ab288e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:41.306448 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-46e60ac4-1ec5-40f2-9e79-61e3713822c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:41.307291 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-46e60ac4-1ec5-40f2-9e79-61e3713822c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:41.320123 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-46e60ac4-1ec5-40f2-9e79-61e3713822c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:41.322629 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-46e60ac4-1ec5-40f2-9e79-61e3713822c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:41.328765 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-46e60ac4-1ec5-40f2-9e79-61e3713822c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:41.329432 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-46e60ac4-1ec5-40f2-9e79-61e3713822c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:41.829661 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-25cf4921-0e04-4db0-9042-e303b1ab288e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:41.850247 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-25cf4921-0e04-4db0-9042-e303b1ab288e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:41.851852 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-25cf4921-0e04-4db0-9042-e303b1ab288e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:41.859767 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-25cf4921-0e04-4db0-9042-e303b1ab288e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1406 microversion: 2.20 time: 0.652634 Apr 08 02:44:41.860427 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 45/82] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:41 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1406 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:41.928960 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5f64f558-7e00-4ee7-906a-c5ccb54ffca5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:41.929958 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5f64f558-7e00-4ee7-906a-c5ccb54ffca5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:41.943674 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5f64f558-7e00-4ee7-906a-c5ccb54ffca5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:41.947101 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5f64f558-7e00-4ee7-906a-c5ccb54ffca5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:41.951909 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5f64f558-7e00-4ee7-906a-c5ccb54ffca5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:41.952704 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5f64f558-7e00-4ee7-906a-c5ccb54ffca5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:42.099654 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-46e60ac4-1ec5-40f2-9e79-61e3713822c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:42.113992 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-46e60ac4-1ec5-40f2-9e79-61e3713822c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1361 microversion: 2.1 time: 0.811954 Apr 08 02:44:42.121106 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 38/83] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:41 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1361 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:42.347055 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5f64f558-7e00-4ee7-906a-c5ccb54ffca5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:42.355088 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5f64f558-7e00-4ee7-906a-c5ccb54ffca5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1367 microversion: 2.1 time: 0.431450 Apr 08 02:44:42.355990 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 46/84] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:41 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1367 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:42.879523 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-cf5af5cf-5da3-48c2-8b81-be0182fd1996 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:42.880135 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-cf5af5cf-5da3-48c2-8b81-be0182fd1996 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:42.889138 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cf5af5cf-5da3-48c2-8b81-be0182fd1996 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:42.889832 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cf5af5cf-5da3-48c2-8b81-be0182fd1996 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:42.891487 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cf5af5cf-5da3-48c2-8b81-be0182fd1996 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:42.892084 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cf5af5cf-5da3-48c2-8b81-be0182fd1996 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:43.134413 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-08c3bbf5-3120-4d22-bbd5-24dbb7596ce8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:43.135548 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-08c3bbf5-3120-4d22-bbd5-24dbb7596ce8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:43.144728 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-08c3bbf5-3120-4d22-bbd5-24dbb7596ce8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:43.145545 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-08c3bbf5-3120-4d22-bbd5-24dbb7596ce8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:43.146370 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-08c3bbf5-3120-4d22-bbd5-24dbb7596ce8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:43.146951 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-08c3bbf5-3120-4d22-bbd5-24dbb7596ce8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:43.147463 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-cf5af5cf-5da3-48c2-8b81-be0182fd1996 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:43.159990 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-cf5af5cf-5da3-48c2-8b81-be0182fd1996 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:43.161503 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-cf5af5cf-5da3-48c2-8b81-be0182fd1996 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:43.162576 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-cf5af5cf-5da3-48c2-8b81-be0182fd1996 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1406 microversion: 2.20 time: 0.287494 Apr 08 02:44:43.163118 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 39/85] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:42 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:44:43.232554 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-b8d4f3c2-ce3b-42f5-8879-01b2398fbcc6 req-32e67a6b-7143-4ce3-b4da-59c140b07714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7ae39c8-31a8-4fff-854c-06275d09d237", "name": "network-vif-plugged", "status": "completed", "tag": "823fa2cc-3d06-401c-8c4e-211154f6e79b"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:43.234251 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:44:43.234251 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:44:43.244760 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-b8d4f3c2-ce3b-42f5-8879-01b2398fbcc6 req-32e67a6b-7143-4ce3-b4da-59c140b07714 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:43.245390 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-b8d4f3c2-ce3b-42f5-8879-01b2398fbcc6 req-32e67a6b-7143-4ce3-b4da-59c140b07714 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:43.266137 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-b8d4f3c2-ce3b-42f5-8879-01b2398fbcc6 req-32e67a6b-7143-4ce3-b4da-59c140b07714 service nova] Creating event network-vif-plugged:823fa2cc-3d06-401c-8c4e-211154f6e79b for instance d7ae39c8-31a8-4fff-854c-06275d09d237 on hv-cinder-83705 Apr 08 02:44:43.271680 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-b8d4f3c2-ce3b-42f5-8879-01b2398fbcc6 req-32e67a6b-7143-4ce3-b4da-59c140b07714 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043875 Apr 08 02:44:43.272556 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 40/86] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:44:43.377196 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-cf10fa8d-1dd7-4a92-98b2-65ffb9ea6968 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:43.377896 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-cf10fa8d-1dd7-4a92-98b2-65ffb9ea6968 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:43.395292 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-08c3bbf5-3120-4d22-bbd5-24dbb7596ce8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:43.400260 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cf10fa8d-1dd7-4a92-98b2-65ffb9ea6968 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:43.400715 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cf10fa8d-1dd7-4a92-98b2-65ffb9ea6968 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:43.401489 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cf10fa8d-1dd7-4a92-98b2-65ffb9ea6968 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:43.401921 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cf10fa8d-1dd7-4a92-98b2-65ffb9ea6968 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:43.410517 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-08c3bbf5-3120-4d22-bbd5-24dbb7596ce8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1361 microversion: 2.1 time: 0.279598 Apr 08 02:44:43.411676 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 47/87] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:43 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1361 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:43.729566 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-cf10fa8d-1dd7-4a92-98b2-65ffb9ea6968 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:43.738886 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-cf10fa8d-1dd7-4a92-98b2-65ffb9ea6968 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1367 microversion: 2.1 time: 0.365897 Apr 08 02:44:43.739445 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 41/88] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:43 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1367 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:44.182721 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-080c32fc-f6ae-4084-ac4f-ac4ab773f952 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:44.184114 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-080c32fc-f6ae-4084-ac4f-ac4ab773f952 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:44.201353 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-080c32fc-f6ae-4084-ac4f-ac4ab773f952 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:44.203509 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-080c32fc-f6ae-4084-ac4f-ac4ab773f952 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:44.204619 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-080c32fc-f6ae-4084-ac4f-ac4ab773f952 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:44.205191 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-080c32fc-f6ae-4084-ac4f-ac4ab773f952 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:44.429871 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ced1a349-9968-4122-8174-9ef468aba6ae tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:44.431291 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ced1a349-9968-4122-8174-9ef468aba6ae tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:44.441281 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ced1a349-9968-4122-8174-9ef468aba6ae tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:44.441976 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ced1a349-9968-4122-8174-9ef468aba6ae tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:44.443072 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ced1a349-9968-4122-8174-9ef468aba6ae tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:44.443715 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ced1a349-9968-4122-8174-9ef468aba6ae tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:44.474527 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-080c32fc-f6ae-4084-ac4f-ac4ab773f952 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:44.489617 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-080c32fc-f6ae-4084-ac4f-ac4ab773f952 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:44.491703 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-080c32fc-f6ae-4084-ac4f-ac4ab773f952 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:44.495854 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-080c32fc-f6ae-4084-ac4f-ac4ab773f952 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1406 microversion: 2.20 time: 0.316232 Apr 08 02:44:44.496789 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 48/89] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:44 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1406 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:44:44.667881 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ced1a349-9968-4122-8174-9ef468aba6ae tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:44.678605 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ced1a349-9968-4122-8174-9ef468aba6ae tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1361 microversion: 2.1 time: 0.253423 Apr 08 02:44:44.679181 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 42/90] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:44 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:44:44.756300 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5ee078ec-74b1-4761-bb73-462ace4d7cc9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:44.756853 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5ee078ec-74b1-4761-bb73-462ace4d7cc9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:44.764649 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5ee078ec-74b1-4761-bb73-462ace4d7cc9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:44.765098 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5ee078ec-74b1-4761-bb73-462ace4d7cc9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:44.765917 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5ee078ec-74b1-4761-bb73-462ace4d7cc9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:44.766348 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5ee078ec-74b1-4761-bb73-462ace4d7cc9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:44.982228 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5ee078ec-74b1-4761-bb73-462ace4d7cc9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:44.990929 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5ee078ec-74b1-4761-bb73-462ace4d7cc9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1367 microversion: 2.1 time: 0.238332 Apr 08 02:44:44.991491 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 49/91] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:44 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:45.290726 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-5e8ab227-e027-413c-9b23-01b7c98f1928 req-916bbf4b-b126-4f86-81c8-cf649a71c10d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff7e510d-5c97-4291-930a-66cd4b8d6137", "name": "network-vif-plugged", "status": "completed", "tag": "0ed67e44-5f92-4862-acd5-9fec0333c514"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:45.292834 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:44:45.292834 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:44:45.303841 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-5e8ab227-e027-413c-9b23-01b7c98f1928 req-916bbf4b-b126-4f86-81c8-cf649a71c10d service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:45.305707 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-5e8ab227-e027-413c-9b23-01b7c98f1928 req-916bbf4b-b126-4f86-81c8-cf649a71c10d service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:45.340348 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-5e8ab227-e027-413c-9b23-01b7c98f1928 req-916bbf4b-b126-4f86-81c8-cf649a71c10d service nova] Creating event network-vif-plugged:0ed67e44-5f92-4862-acd5-9fec0333c514 for instance ff7e510d-5c97-4291-930a-66cd4b8d6137 on hv-cinder-83705 Apr 08 02:44:45.346756 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-5e8ab227-e027-413c-9b23-01b7c98f1928 req-916bbf4b-b126-4f86-81c8-cf649a71c10d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059650 Apr 08 02:44:45.347852 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 43/92] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:45.515905 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-14bfdad7-250e-4955-a10e-d6d55cf9d113 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:45.516552 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-14bfdad7-250e-4955-a10e-d6d55cf9d113 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:45.539807 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-14bfdad7-250e-4955-a10e-d6d55cf9d113 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:45.540482 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-14bfdad7-250e-4955-a10e-d6d55cf9d113 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:45.541162 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-14bfdad7-250e-4955-a10e-d6d55cf9d113 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:45.541598 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-14bfdad7-250e-4955-a10e-d6d55cf9d113 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:45.696576 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ce3a3edb-67e9-4e5d-b102-c492607f3cf3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:45.697427 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ce3a3edb-67e9-4e5d-b102-c492607f3cf3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:45.715580 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ce3a3edb-67e9-4e5d-b102-c492607f3cf3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:45.716690 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ce3a3edb-67e9-4e5d-b102-c492607f3cf3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:45.717386 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ce3a3edb-67e9-4e5d-b102-c492607f3cf3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:45.717923 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ce3a3edb-67e9-4e5d-b102-c492607f3cf3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:45.922179 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-14bfdad7-250e-4955-a10e-d6d55cf9d113 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:45.936088 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-14bfdad7-250e-4955-a10e-d6d55cf9d113 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:45.938350 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-14bfdad7-250e-4955-a10e-d6d55cf9d113 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:45.940449 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-14bfdad7-250e-4955-a10e-d6d55cf9d113 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1598 microversion: 2.20 time: 0.428970 Apr 08 02:44:45.941608 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 50/93] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:44:45 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1598 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:44:45.960063 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1123eb3d-8a90-4bb3-8941-b119b7705286 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:45.961606 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1123eb3d-8a90-4bb3-8941-b119b7705286 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:45.971617 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1123eb3d-8a90-4bb3-8941-b119b7705286 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:45.980509 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1123eb3d-8a90-4bb3-8941-b119b7705286 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:45.981547 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1123eb3d-8a90-4bb3-8941-b119b7705286 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:45.982034 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1123eb3d-8a90-4bb3-8941-b119b7705286 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:46.145194 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1123eb3d-8a90-4bb3-8941-b119b7705286 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.189682 Apr 08 02:44:46.146005 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 51/94] 10.222.0.23 () {60 vars in 1315 bytes} [Fri Apr 8 02:44:45 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 02:44:46.151425 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-055a2ba2-0ac2-48f2-a9cf-e73dff9fccf0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:46.152753 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-055a2ba2-0ac2-48f2-a9cf-e73dff9fccf0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:46.162499 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-055a2ba2-0ac2-48f2-a9cf-e73dff9fccf0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:46.162948 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-055a2ba2-0ac2-48f2-a9cf-e73dff9fccf0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:46.163911 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-055a2ba2-0ac2-48f2-a9cf-e73dff9fccf0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:46.164387 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-055a2ba2-0ac2-48f2-a9cf-e73dff9fccf0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:46.165727 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ce3a3edb-67e9-4e5d-b102-c492607f3cf3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:46.175840 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ce3a3edb-67e9-4e5d-b102-c492607f3cf3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1361 microversion: 2.1 time: 0.483335 Apr 08 02:44:46.176475 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 44/95] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:45 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1361 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:46.676479 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-055a2ba2-0ac2-48f2-a9cf-e73dff9fccf0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:46.689908 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-055a2ba2-0ac2-48f2-a9cf-e73dff9fccf0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1556 microversion: 2.1 time: 0.542762 Apr 08 02:44:46.690489 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 52/96] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:46 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1556 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:46.710296 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4f4278c5-bb28-4782-89dd-b7adedf06335 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:46.710774 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-4f4278c5-bb28-4782-89dd-b7adedf06335 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:46.718659 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4f4278c5-bb28-4782-89dd-b7adedf06335 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:46.719292 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4f4278c5-bb28-4782-89dd-b7adedf06335 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:46.720905 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4f4278c5-bb28-4782-89dd-b7adedf06335 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:46.721483 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4f4278c5-bb28-4782-89dd-b7adedf06335 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:46.923865 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4f4278c5-bb28-4782-89dd-b7adedf06335 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.217451 Apr 08 02:44:46.931088 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 45/97] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Apr 8 02:44:46 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237/os-interface => generated 284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:47.194582 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-30956003-a238-4967-9921-e93fb82988c4 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:47.196477 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-30956003-a238-4967-9921-e93fb82988c4 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:47.225980 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-30956003-a238-4967-9921-e93fb82988c4 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:47.228531 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-30956003-a238-4967-9921-e93fb82988c4 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:47.230747 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-30956003-a238-4967-9921-e93fb82988c4 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:47.231439 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-30956003-a238-4967-9921-e93fb82988c4 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:47.823771 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-30956003-a238-4967-9921-e93fb82988c4 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:47.847660 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-30956003-a238-4967-9921-e93fb82988c4 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1361 microversion: 2.1 time: 0.657559 Apr 08 02:44:47.848100 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 53/98] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:47 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1361 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:48.486998 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f5c1591f-5e74-4eed-8d44-1925707fce30 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:48.488166 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f5c1591f-5e74-4eed-8d44-1925707fce30 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:48.496194 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f5c1591f-5e74-4eed-8d44-1925707fce30 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:48.496944 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f5c1591f-5e74-4eed-8d44-1925707fce30 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:48.498235 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f5c1591f-5e74-4eed-8d44-1925707fce30 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:48.498897 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f5c1591f-5e74-4eed-8d44-1925707fce30 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:48.616529 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f5c1591f-5e74-4eed-8d44-1925707fce30 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Going to try to terminate instance {{(pid=101271) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:44:48.796715 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f5c1591f-5e74-4eed-8d44-1925707fce30 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 204 len: 0 microversion: 2.1 time: 0.310539 Apr 08 02:44:48.797389 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 46/99] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:44:48 2022] DELETE /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:44:48.805692 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4331871e-a4af-402e-b1bb-3dc0dc32725e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:48.806608 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4331871e-a4af-402e-b1bb-3dc0dc32725e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:48.814985 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4331871e-a4af-402e-b1bb-3dc0dc32725e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:48.815750 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4331871e-a4af-402e-b1bb-3dc0dc32725e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:48.821976 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4331871e-a4af-402e-b1bb-3dc0dc32725e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:48.823370 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4331871e-a4af-402e-b1bb-3dc0dc32725e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:48.866722 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b9e3e533-aedc-4208-b056-045c0b059d25 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:48.867693 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b9e3e533-aedc-4208-b056-045c0b059d25 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:48.883997 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b9e3e533-aedc-4208-b056-045c0b059d25 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:48.886700 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b9e3e533-aedc-4208-b056-045c0b059d25 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:48.887767 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b9e3e533-aedc-4208-b056-045c0b059d25 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:48.890153 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b9e3e533-aedc-4208-b056-045c0b059d25 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:49.335186 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4331871e-a4af-402e-b1bb-3dc0dc32725e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:49.347568 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-4331871e-a4af-402e-b1bb-3dc0dc32725e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1552 microversion: 2.1 time: 0.544541 Apr 08 02:44:49.358936 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 54/100] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:48 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1552 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:44:49.369484 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-685ffc11-c5ba-4659-8917-d1eceac07ac8 req-4cfe3040-199f-441c-b466-9bedb613262a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a1344c-2d91-4224-ab68-1898d4aa8b0f", "tag": "19d6323f-cbfa-4743-8474-008e1a45beee"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:49.374555 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:44:49.374555 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:44:49.384809 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-685ffc11-c5ba-4659-8917-d1eceac07ac8 req-4cfe3040-199f-441c-b466-9bedb613262a service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:49.385597 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-685ffc11-c5ba-4659-8917-d1eceac07ac8 req-4cfe3040-199f-441c-b466-9bedb613262a service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:49.408050 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-685ffc11-c5ba-4659-8917-d1eceac07ac8 req-4cfe3040-199f-441c-b466-9bedb613262a service nova] Creating event network-changed:19d6323f-cbfa-4743-8474-008e1a45beee for instance 89a1344c-2d91-4224-ab68-1898d4aa8b0f on hv-cinder-83705 Apr 08 02:44:49.413624 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-685ffc11-c5ba-4659-8917-d1eceac07ac8 req-4cfe3040-199f-441c-b466-9bedb613262a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051817 Apr 08 02:44:49.415404 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 55/101] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:49.682289 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b9e3e533-aedc-4208-b056-045c0b059d25 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:49.695555 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b9e3e533-aedc-4208-b056-045c0b059d25 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1546 microversion: 2.1 time: 0.833970 Apr 08 02:44:49.700755 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 47/102] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:48 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1546 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:44:49.723182 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e1262d0c-fb2c-485a-8164-645c9f7b6bc7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:49.724057 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e1262d0c-fb2c-485a-8164-645c9f7b6bc7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:49.741512 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e1262d0c-fb2c-485a-8164-645c9f7b6bc7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:49.741968 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e1262d0c-fb2c-485a-8164-645c9f7b6bc7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:49.746498 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e1262d0c-fb2c-485a-8164-645c9f7b6bc7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:49.746970 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e1262d0c-fb2c-485a-8164-645c9f7b6bc7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:49.904331 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-7df8f4c1-314a-495e-896a-09644a93b5a1 req-87ad4b1a-d404-4353-9471-d4127fa27677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7ae39c8-31a8-4fff-854c-06275d09d237", "tag": "823fa2cc-3d06-401c-8c4e-211154f6e79b"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:49.906100 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:44:49.906100 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:44:49.917187 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-7df8f4c1-314a-495e-896a-09644a93b5a1 req-87ad4b1a-d404-4353-9471-d4127fa27677 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:49.928594 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-7df8f4c1-314a-495e-896a-09644a93b5a1 req-87ad4b1a-d404-4353-9471-d4127fa27677 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:49.989329 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-7df8f4c1-314a-495e-896a-09644a93b5a1 req-87ad4b1a-d404-4353-9471-d4127fa27677 service nova] Creating event network-changed:823fa2cc-3d06-401c-8c4e-211154f6e79b for instance d7ae39c8-31a8-4fff-854c-06275d09d237 on hv-cinder-83705 Apr 08 02:44:50.001615 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-7df8f4c1-314a-495e-896a-09644a93b5a1 req-87ad4b1a-d404-4353-9471-d4127fa27677 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113325 Apr 08 02:44:50.002384 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 48/103] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Apr 08 02:44:50.237842 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e1262d0c-fb2c-485a-8164-645c9f7b6bc7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.518553 Apr 08 02:44:50.238997 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 56/104] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Apr 8 02:44:49 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/os-interface => generated 284 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:50.366068 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e7998e60-6fa2-4dc1-89ab-4a3b1a4f0dd0 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:50.366939 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e7998e60-6fa2-4dc1-89ab-4a3b1a4f0dd0 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:50.380093 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e7998e60-6fa2-4dc1-89ab-4a3b1a4f0dd0 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:50.380544 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e7998e60-6fa2-4dc1-89ab-4a3b1a4f0dd0 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:50.381338 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e7998e60-6fa2-4dc1-89ab-4a3b1a4f0dd0 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:50.381777 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e7998e60-6fa2-4dc1-89ab-4a3b1a4f0dd0 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:50.986714 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e7998e60-6fa2-4dc1-89ab-4a3b1a4f0dd0 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:51.002546 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e7998e60-6fa2-4dc1-89ab-4a3b1a4f0dd0 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1552 microversion: 2.1 time: 0.640355 Apr 08 02:44:51.005159 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 49/105] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:50 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1552 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:52.018962 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f864f8ad-0aff-41ca-80ea-d385166c21b7 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:52.020740 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f864f8ad-0aff-41ca-80ea-d385166c21b7 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:52.028527 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f864f8ad-0aff-41ca-80ea-d385166c21b7 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:52.029334 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f864f8ad-0aff-41ca-80ea-d385166c21b7 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:52.030577 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f864f8ad-0aff-41ca-80ea-d385166c21b7 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:52.031407 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f864f8ad-0aff-41ca-80ea-d385166c21b7 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:52.516927 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f864f8ad-0aff-41ca-80ea-d385166c21b7 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:52.525730 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f864f8ad-0aff-41ca-80ea-d385166c21b7 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1552 microversion: 2.1 time: 0.510496 Apr 08 02:44:52.526306 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 57/106] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:52 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1552 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:52.753636 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-3f614eaf-ba75-4675-917c-ab31e22d11d9 req-3cbe1675-96db-47c9-9b04-24067b75bdcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff7e510d-5c97-4291-930a-66cd4b8d6137", "tag": "0ed67e44-5f92-4862-acd5-9fec0333c514"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:52.757485 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:44:52.757485 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:44:52.765713 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-3f614eaf-ba75-4675-917c-ab31e22d11d9 req-3cbe1675-96db-47c9-9b04-24067b75bdcd service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:52.766152 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-3f614eaf-ba75-4675-917c-ab31e22d11d9 req-3cbe1675-96db-47c9-9b04-24067b75bdcd service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:52.782209 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-3f614eaf-ba75-4675-917c-ab31e22d11d9 req-3cbe1675-96db-47c9-9b04-24067b75bdcd service nova] Creating event network-changed:0ed67e44-5f92-4862-acd5-9fec0333c514 for instance ff7e510d-5c97-4291-930a-66cd4b8d6137 on hv-cinder-83705 Apr 08 02:44:52.787023 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-3f614eaf-ba75-4675-917c-ab31e22d11d9 req-3cbe1675-96db-47c9-9b04-24067b75bdcd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037130 Apr 08 02:44:52.787694 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 50/107] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:53.542548 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-356d5762-a62e-4dcb-8b65-acadc29ecedb tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:53.543154 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-356d5762-a62e-4dcb-8b65-acadc29ecedb tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:53.551136 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-356d5762-a62e-4dcb-8b65-acadc29ecedb tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:53.551600 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-356d5762-a62e-4dcb-8b65-acadc29ecedb tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:53.552387 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-356d5762-a62e-4dcb-8b65-acadc29ecedb tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:53.553082 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-356d5762-a62e-4dcb-8b65-acadc29ecedb tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:53.751148 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-356d5762-a62e-4dcb-8b65-acadc29ecedb tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:53.759947 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-356d5762-a62e-4dcb-8b65-acadc29ecedb tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1552 microversion: 2.1 time: 0.220904 Apr 08 02:44:53.761400 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 58/108] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:53 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1552 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:54.778791 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c14e2b92-3155-4d9d-a32a-0d9d9a7b99a9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:54.779355 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c14e2b92-3155-4d9d-a32a-0d9d9a7b99a9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:54.786570 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c14e2b92-3155-4d9d-a32a-0d9d9a7b99a9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:54.787020 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c14e2b92-3155-4d9d-a32a-0d9d9a7b99a9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:54.787783 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c14e2b92-3155-4d9d-a32a-0d9d9a7b99a9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:54.788405 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c14e2b92-3155-4d9d-a32a-0d9d9a7b99a9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:55.230327 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c14e2b92-3155-4d9d-a32a-0d9d9a7b99a9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:55.239624 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c14e2b92-3155-4d9d-a32a-0d9d9a7b99a9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1552 microversion: 2.1 time: 0.465528 Apr 08 02:44:55.240230 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 51/109] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:54 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1552 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:56.256936 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-046c8a6e-e3d5-4d5f-ae8d-b96157f7a843 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:56.257501 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-046c8a6e-e3d5-4d5f-ae8d-b96157f7a843 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:56.265145 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-046c8a6e-e3d5-4d5f-ae8d-b96157f7a843 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:56.265584 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-046c8a6e-e3d5-4d5f-ae8d-b96157f7a843 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:56.266339 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-046c8a6e-e3d5-4d5f-ae8d-b96157f7a843 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:56.266764 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-046c8a6e-e3d5-4d5f-ae8d-b96157f7a843 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:56.598012 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-046c8a6e-e3d5-4d5f-ae8d-b96157f7a843 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:56.607550 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-046c8a6e-e3d5-4d5f-ae8d-b96157f7a843 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1552 microversion: 2.1 time: 0.354260 Apr 08 02:44:56.608172 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 59/110] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:56 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1552 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:57.625007 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-32e70424-6b97-4720-afc3-c7f1b02094ec tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:57.625621 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-32e70424-6b97-4720-afc3-c7f1b02094ec tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:57.632800 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-32e70424-6b97-4720-afc3-c7f1b02094ec tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:57.633242 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-32e70424-6b97-4720-afc3-c7f1b02094ec tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:57.633994 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-32e70424-6b97-4720-afc3-c7f1b02094ec tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:57.634421 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-32e70424-6b97-4720-afc3-c7f1b02094ec tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:57.828839 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-32e70424-6b97-4720-afc3-c7f1b02094ec tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:57.837336 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-32e70424-6b97-4720-afc3-c7f1b02094ec tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1552 microversion: 2.1 time: 0.216428 Apr 08 02:44:57.837896 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 52/111] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:57 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1552 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:58.855016 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c1c92444-ea5c-4bd0-81f8-6f67eb9a8211 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:58.855682 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c1c92444-ea5c-4bd0-81f8-6f67eb9a8211 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:44:58.863430 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c1c92444-ea5c-4bd0-81f8-6f67eb9a8211 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:58.863873 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c1c92444-ea5c-4bd0-81f8-6f67eb9a8211 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:58.864655 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c1c92444-ea5c-4bd0-81f8-6f67eb9a8211 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:58.865082 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c1c92444-ea5c-4bd0-81f8-6f67eb9a8211 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:59.064965 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c1c92444-ea5c-4bd0-81f8-6f67eb9a8211 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:44:59.073507 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c1c92444-ea5c-4bd0-81f8-6f67eb9a8211 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1552 microversion: 2.1 time: 0.222177 Apr 08 02:44:59.074062 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 60/112] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:58 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1552 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:00.090742 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-3f8be234-6c30-4556-8fbd-9b3cf9c08e80 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:00.091359 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-3f8be234-6c30-4556-8fbd-9b3cf9c08e80 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:00.099119 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3f8be234-6c30-4556-8fbd-9b3cf9c08e80 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:00.099567 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3f8be234-6c30-4556-8fbd-9b3cf9c08e80 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:00.100371 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3f8be234-6c30-4556-8fbd-9b3cf9c08e80 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:00.100808 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3f8be234-6c30-4556-8fbd-9b3cf9c08e80 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:00.346355 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3f8be234-6c30-4556-8fbd-9b3cf9c08e80 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:00.357732 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-3f8be234-6c30-4556-8fbd-9b3cf9c08e80 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1552 microversion: 2.1 time: 0.269983 Apr 08 02:45:00.365579 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 53/113] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:00 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1552 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:00.628861 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-e7379a0f-7c9a-442a-9f9d-e575ba71f4b7 req-889d72cb-b690-4132-893d-773b379a5fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7abd5e4-0438-45c3-bad1-9779674a6e4b", "name": "network-vif-unplugged", "status": "completed", "tag": "f0ff52a0-7fb7-43b6-a51f-a6b036a7209c"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:00.631157 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:45:00.631157 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:45:00.641135 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-e7379a0f-7c9a-442a-9f9d-e575ba71f4b7 req-889d72cb-b690-4132-893d-773b379a5fc8 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:00.641799 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-e7379a0f-7c9a-442a-9f9d-e575ba71f4b7 req-889d72cb-b690-4132-893d-773b379a5fc8 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:00.659969 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-e7379a0f-7c9a-442a-9f9d-e575ba71f4b7 req-889d72cb-b690-4132-893d-773b379a5fc8 service nova] Creating event network-vif-unplugged:f0ff52a0-7fb7-43b6-a51f-a6b036a7209c for instance a7abd5e4-0438-45c3-bad1-9779674a6e4b on hv-cinder-83705 Apr 08 02:45:00.666050 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-e7379a0f-7c9a-442a-9f9d-e575ba71f4b7 req-889d72cb-b690-4132-893d-773b379a5fc8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042079 Apr 08 02:45:00.666925 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 61/114] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:45:01.375061 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-0369fd8d-f7c7-4fc3-a1dc-fb4cd569d510 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:01.375776 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-0369fd8d-f7c7-4fc3-a1dc-fb4cd569d510 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:01.384750 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0369fd8d-f7c7-4fc3-a1dc-fb4cd569d510 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:01.385200 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0369fd8d-f7c7-4fc3-a1dc-fb4cd569d510 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:01.385985 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0369fd8d-f7c7-4fc3-a1dc-fb4cd569d510 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:01.386424 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0369fd8d-f7c7-4fc3-a1dc-fb4cd569d510 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:01.600914 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0369fd8d-f7c7-4fc3-a1dc-fb4cd569d510 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:01.609659 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-0369fd8d-f7c7-4fc3-a1dc-fb4cd569d510 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1552 microversion: 2.1 time: 0.238400 Apr 08 02:45:01.610243 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 54/115] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:01 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1552 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:02.313751 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-99891c4b-2be1-40af-be90-f63ca3863b5d req-e719be90-d0b0-4dd1-9419-f101c83097f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7abd5e4-0438-45c3-bad1-9779674a6e4b", "name": "network-vif-deleted", "tag": "f0ff52a0-7fb7-43b6-a51f-a6b036a7209c"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:02.315260 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:45:02.315260 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:45:02.324345 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-99891c4b-2be1-40af-be90-f63ca3863b5d req-e719be90-d0b0-4dd1-9419-f101c83097f5 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:02.324788 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-99891c4b-2be1-40af-be90-f63ca3863b5d req-e719be90-d0b0-4dd1-9419-f101c83097f5 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:02.341092 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-99891c4b-2be1-40af-be90-f63ca3863b5d req-e719be90-d0b0-4dd1-9419-f101c83097f5 service nova] Creating event network-vif-deleted:f0ff52a0-7fb7-43b6-a51f-a6b036a7209c for instance a7abd5e4-0438-45c3-bad1-9779674a6e4b on hv-cinder-83705 Apr 08 02:45:02.345867 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-99891c4b-2be1-40af-be90-f63ca3863b5d req-e719be90-d0b0-4dd1-9419-f101c83097f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037371 Apr 08 02:45:02.346473 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 62/116] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:45:02.626378 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-873ca1b4-4ff2-4e7b-9ff8-0d4454f5dcca tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:02.627047 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-873ca1b4-4ff2-4e7b-9ff8-0d4454f5dcca tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:02.634597 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-873ca1b4-4ff2-4e7b-9ff8-0d4454f5dcca tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:02.635047 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-873ca1b4-4ff2-4e7b-9ff8-0d4454f5dcca tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:02.635894 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-873ca1b4-4ff2-4e7b-9ff8-0d4454f5dcca tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:02.636361 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-873ca1b4-4ff2-4e7b-9ff8-0d4454f5dcca tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:02.747627 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-873ca1b4-4ff2-4e7b-9ff8-0d4454f5dcca tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:02.756349 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-873ca1b4-4ff2-4e7b-9ff8-0d4454f5dcca tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1510 microversion: 2.1 time: 0.133694 Apr 08 02:45:02.756914 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 55/117] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:02 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1510 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:03.774116 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9cfb78c3-6beb-4f8d-9b50-3582c9f0cba3 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:03.774750 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9cfb78c3-6beb-4f8d-9b50-3582c9f0cba3 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:03.783004 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9cfb78c3-6beb-4f8d-9b50-3582c9f0cba3 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:03.783444 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9cfb78c3-6beb-4f8d-9b50-3582c9f0cba3 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:03.784236 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9cfb78c3-6beb-4f8d-9b50-3582c9f0cba3 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:03.784666 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9cfb78c3-6beb-4f8d-9b50-3582c9f0cba3 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:03.911841 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9cfb78c3-6beb-4f8d-9b50-3582c9f0cba3 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:03.920727 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9cfb78c3-6beb-4f8d-9b50-3582c9f0cba3 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1510 microversion: 2.1 time: 0.150938 Apr 08 02:45:03.921279 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 63/118] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:03 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:04.937669 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-db474d99-ef94-4530-87ed-6ba22014e4a5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:04.938286 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-db474d99-ef94-4530-87ed-6ba22014e4a5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:04.945517 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-db474d99-ef94-4530-87ed-6ba22014e4a5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:04.945963 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-db474d99-ef94-4530-87ed-6ba22014e4a5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:04.946723 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-db474d99-ef94-4530-87ed-6ba22014e4a5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:04.947156 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-db474d99-ef94-4530-87ed-6ba22014e4a5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:05.068421 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-db474d99-ef94-4530-87ed-6ba22014e4a5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:05.080866 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-db474d99-ef94-4530-87ed-6ba22014e4a5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1510 microversion: 2.1 time: 0.146832 Apr 08 02:45:05.081605 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 56/119] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:04 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:06.099773 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-40553543-0404-4803-94f3-27701180e0bc tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:06.100400 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-40553543-0404-4803-94f3-27701180e0bc tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:06.108108 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-40553543-0404-4803-94f3-27701180e0bc tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:06.108548 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-40553543-0404-4803-94f3-27701180e0bc tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:06.109294 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-40553543-0404-4803-94f3-27701180e0bc tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:06.109718 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-40553543-0404-4803-94f3-27701180e0bc tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:06.224198 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-40553543-0404-4803-94f3-27701180e0bc tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:06.233547 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-40553543-0404-4803-94f3-27701180e0bc tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1346 microversion: 2.1 time: 0.137483 Apr 08 02:45:06.234091 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 64/120] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:06 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1346 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:07.250334 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f7e1fdba-6eba-4d0e-930d-1715d8238dd9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:07.250967 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f7e1fdba-6eba-4d0e-930d-1715d8238dd9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:07.258017 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f7e1fdba-6eba-4d0e-930d-1715d8238dd9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:07.258457 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f7e1fdba-6eba-4d0e-930d-1715d8238dd9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:07.259209 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f7e1fdba-6eba-4d0e-930d-1715d8238dd9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:07.259639 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f7e1fdba-6eba-4d0e-930d-1715d8238dd9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:07.369981 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f7e1fdba-6eba-4d0e-930d-1715d8238dd9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:07.379054 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f7e1fdba-6eba-4d0e-930d-1715d8238dd9 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1346 microversion: 2.1 time: 0.132891 Apr 08 02:45:07.379610 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 57/121] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:07 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1346 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:08.397503 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-fe4dea6b-4ce7-4746-b087-840d6866e4d5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:08.398845 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-fe4dea6b-4ce7-4746-b087-840d6866e4d5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:08.408327 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fe4dea6b-4ce7-4746-b087-840d6866e4d5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:08.408784 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fe4dea6b-4ce7-4746-b087-840d6866e4d5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:08.409570 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fe4dea6b-4ce7-4746-b087-840d6866e4d5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:08.410006 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fe4dea6b-4ce7-4746-b087-840d6866e4d5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:08.529814 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-fe4dea6b-4ce7-4746-b087-840d6866e4d5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:08.538412 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-fe4dea6b-4ce7-4746-b087-840d6866e4d5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1346 microversion: 2.1 time: 0.145854 Apr 08 02:45:08.538967 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 65/122] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:08 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1346 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:09.555787 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-285ef54a-8b19-4883-8bcd-50410b060b4a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:09.556385 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-285ef54a-8b19-4883-8bcd-50410b060b4a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:09.566154 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-285ef54a-8b19-4883-8bcd-50410b060b4a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:09.566767 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-285ef54a-8b19-4883-8bcd-50410b060b4a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:09.567812 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-285ef54a-8b19-4883-8bcd-50410b060b4a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:09.568309 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-285ef54a-8b19-4883-8bcd-50410b060b4a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:09.660428 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-285ef54a-8b19-4883-8bcd-50410b060b4a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:09.660945 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-285ef54a-8b19-4883-8bcd-50410b060b4a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:09.661393 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.objects.instance [None req-285ef54a-8b19-4883-8bcd-50410b060b4a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lazy-loading 'fault' on Instance uuid a7abd5e4-0438-45c3-bad1-9779674a6e4b {{(pid=101271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:45:09.730880 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-285ef54a-8b19-4883-8bcd-50410b060b4a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ebb03a3a3f4e8cbc996251a4fefb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7827966303d4944b40900c83b7d40b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:09.738168 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-285ef54a-8b19-4883-8bcd-50410b060b4a tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 200 len: 1351 microversion: 2.1 time: 0.186621 Apr 08 02:45:09.738742 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 58/123] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:09 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 1351 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:10.756740 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-681dccf7-13cd-4ddd-bf25-ddd930a7e8b5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:10.758249 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-681dccf7-13cd-4ddd-bf25-ddd930a7e8b5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:10.766374 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-681dccf7-13cd-4ddd-bf25-ddd930a7e8b5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:10.766921 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-681dccf7-13cd-4ddd-bf25-ddd930a7e8b5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:10.767796 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-681dccf7-13cd-4ddd-bf25-ddd930a7e8b5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:10.768255 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-681dccf7-13cd-4ddd-bf25-ddd930a7e8b5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:10.822387 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-681dccf7-13cd-4ddd-bf25-ddd930a7e8b5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] HTTP exception thrown: Instance a7abd5e4-0438-45c3-bad1-9779674a6e4b could not be found. Apr 08 02:45:10.823022 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-681dccf7-13cd-4ddd-bf25-ddd930a7e8b5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Returning 404 to user: Instance a7abd5e4-0438-45c3-bad1-9779674a6e4b could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:45:10.823883 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-681dccf7-13cd-4ddd-bf25-ddd930a7e8b5 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 404 len: 111 microversion: 2.1 time: 0.071642 Apr 08 02:45:10.824400 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 66/124] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:10 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:45:11.001170 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d716f430-cbb9-4f16-9233-0583fd123c14 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:11.002102 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-d716f430-cbb9-4f16-9233-0583fd123c14 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:11.009477 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d716f430-cbb9-4f16-9233-0583fd123c14 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:11.009930 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d716f430-cbb9-4f16-9233-0583fd123c14 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:11.010693 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d716f430-cbb9-4f16-9233-0583fd123c14 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:11.011130 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d716f430-cbb9-4f16-9233-0583fd123c14 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:11.066731 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-d716f430-cbb9-4f16-9233-0583fd123c14 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] HTTP exception thrown: Instance a7abd5e4-0438-45c3-bad1-9779674a6e4b could not be found. Apr 08 02:45:11.067343 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d716f430-cbb9-4f16-9233-0583fd123c14 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Returning 404 to user: Instance a7abd5e4-0438-45c3-bad1-9779674a6e4b could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:45:11.068192 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-d716f430-cbb9-4f16-9233-0583fd123c14 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.071475 Apr 08 02:45:11.068953 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 59/125] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:45:10 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b/os-volume_attachments => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:45:12.626773 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-15ee9c98-8c54-4f49-a09d-3a654b5b2d1e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:12.627419 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-15ee9c98-8c54-4f49-a09d-3a654b5b2d1e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:12.634712 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-15ee9c98-8c54-4f49-a09d-3a654b5b2d1e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:12.635151 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-15ee9c98-8c54-4f49-a09d-3a654b5b2d1e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:12.635945 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-15ee9c98-8c54-4f49-a09d-3a654b5b2d1e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:12.636369 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-15ee9c98-8c54-4f49-a09d-3a654b5b2d1e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:12.692428 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-15ee9c98-8c54-4f49-a09d-3a654b5b2d1e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] HTTP exception thrown: Instance a7abd5e4-0438-45c3-bad1-9779674a6e4b could not be found. Apr 08 02:45:12.692967 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-15ee9c98-8c54-4f49-a09d-3a654b5b2d1e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Returning 404 to user: Instance a7abd5e4-0438-45c3-bad1-9779674a6e4b could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:45:12.693798 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-15ee9c98-8c54-4f49-a09d-3a654b5b2d1e tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 404 len: 111 microversion: 2.1 time: 0.070877 Apr 08 02:45:12.694540 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 67/126] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:45:12 2022] DELETE /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:45:12.702695 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-46e73fcf-e2a0-4306-8d26-c1286bda1f27 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:12.703317 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-46e73fcf-e2a0-4306-8d26-c1286bda1f27 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] [instance: a7abd5e4-0438-45c3-bad1-9779674a6e4b] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:12.710617 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-46e73fcf-e2a0-4306-8d26-c1286bda1f27 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:12.711186 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-46e73fcf-e2a0-4306-8d26-c1286bda1f27 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:12.712363 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-46e73fcf-e2a0-4306-8d26-c1286bda1f27 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:12.713129 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-46e73fcf-e2a0-4306-8d26-c1286bda1f27 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:12.768946 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-46e73fcf-e2a0-4306-8d26-c1286bda1f27 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] HTTP exception thrown: Instance a7abd5e4-0438-45c3-bad1-9779674a6e4b could not be found. Apr 08 02:45:12.769787 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-46e73fcf-e2a0-4306-8d26-c1286bda1f27 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] Returning 404 to user: Instance a7abd5e4-0438-45c3-bad1-9779674a6e4b could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:45:12.771227 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-46e73fcf-e2a0-4306-8d26-c1286bda1f27 tempest-DeleteServersTestJSON-913894801 tempest-DeleteServersTestJSON-913894801-project] 10.222.0.23 "GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b" status: 404 len: 111 microversion: 2.1 time: 0.072628 Apr 08 02:45:12.771786 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 60/127] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:12 2022] GET /compute/v2.1/servers/a7abd5e4-0438-45c3-bad1-9779674a6e4b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:45:22.012262 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4f354434-a4a5-4ee3-bfd2-cb17410f7808 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1261889633", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:22.077508 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.network.neutron [None req-4f354434-a4a5-4ee3-bfd2-cb17410f7808 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] validate_networks() for [('94ddd372-ab57-40b5-ae02-402f4da20997', None, None, None)] {{(pid=101272) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:45:22.827966 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-4f354434-a4a5-4ee3-bfd2-cb17410f7808 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Flavor limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:45:22.828305 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-4f354434-a4a5-4ee3-bfd2-cb17410f7808 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Image limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:45:22.828775 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-4f354434-a4a5-4ee3-bfd2-cb17410f7808 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Flavor pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:45:22.829180 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-4f354434-a4a5-4ee3-bfd2-cb17410f7808 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Image pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:45:22.829583 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-4f354434-a4a5-4ee3-bfd2-cb17410f7808 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:45:22.837851 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4f354434-a4a5-4ee3-bfd2-cb17410f7808 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:22.838289 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4f354434-a4a5-4ee3-bfd2-cb17410f7808 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:22.839077 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4f354434-a4a5-4ee3-bfd2-cb17410f7808 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:22.839740 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4f354434-a4a5-4ee3-bfd2-cb17410f7808 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:22.860772 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-4f354434-a4a5-4ee3-bfd2-cb17410f7808 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Getting quotas for project bd1b3bd04ce44cd7893a53eb18d9a8b0. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:45:22.864982 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-4f354434-a4a5-4ee3-bfd2-cb17410f7808 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Getting quotas for user b3cc30404a3c4a16aff55c90e698e489 and project bd1b3bd04ce44cd7893a53eb18d9a8b0. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:45:22.877236 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4f354434-a4a5-4ee3-bfd2-cb17410f7808 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Going to run 1 instances... {{(pid=101272) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:45:22.879613 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4f354434-a4a5-4ee3-bfd2-cb17410f7808 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:45:22.935375 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-4f354434-a4a5-4ee3-bfd2-cb17410f7808 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.048421 Apr 08 02:45:22.936922 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 68/128] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:45:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:45:22.947790 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1114c990-c3ca-49a3-b1b8-ab336f0056f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:22.949214 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1114c990-c3ca-49a3-b1b8-ab336f0056f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:23.084606 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1114c990-c3ca-49a3-b1b8-ab336f0056f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:23.098125 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1114c990-c3ca-49a3-b1b8-ab336f0056f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1222 microversion: 2.1 time: 0.154972 Apr 08 02:45:23.099138 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 61/129] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:22 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:23.233311 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5724559d-42cd-4a2e-b5f8-4fbd9b725a08 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-529303925", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:23.316858 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.network.neutron [None req-5724559d-42cd-4a2e-b5f8-4fbd9b725a08 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] validate_networks() for [('94ddd372-ab57-40b5-ae02-402f4da20997', None, None, None)] {{(pid=101272) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:45:23.970096 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-5724559d-42cd-4a2e-b5f8-4fbd9b725a08 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Flavor limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:45:23.970706 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-5724559d-42cd-4a2e-b5f8-4fbd9b725a08 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Image limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:45:23.971540 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-5724559d-42cd-4a2e-b5f8-4fbd9b725a08 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Flavor pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:45:23.972465 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-5724559d-42cd-4a2e-b5f8-4fbd9b725a08 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Image pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:45:23.973187 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-5724559d-42cd-4a2e-b5f8-4fbd9b725a08 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:45:23.985530 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5724559d-42cd-4a2e-b5f8-4fbd9b725a08 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:23.986305 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5724559d-42cd-4a2e-b5f8-4fbd9b725a08 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:23.987286 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5724559d-42cd-4a2e-b5f8-4fbd9b725a08 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:23.988082 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5724559d-42cd-4a2e-b5f8-4fbd9b725a08 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:24.009522 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-5724559d-42cd-4a2e-b5f8-4fbd9b725a08 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Getting quotas for project bd1b3bd04ce44cd7893a53eb18d9a8b0. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:45:24.014317 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-5724559d-42cd-4a2e-b5f8-4fbd9b725a08 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Getting quotas for user b3cc30404a3c4a16aff55c90e698e489 and project bd1b3bd04ce44cd7893a53eb18d9a8b0. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:45:24.026320 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5724559d-42cd-4a2e-b5f8-4fbd9b725a08 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Going to run 1 instances... {{(pid=101272) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:45:24.028745 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5724559d-42cd-4a2e-b5f8-4fbd9b725a08 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:45:24.093763 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5724559d-42cd-4a2e-b5f8-4fbd9b725a08 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.865625 Apr 08 02:45:24.104499 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 69/130] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:45:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:45:24.116810 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c02350ff-6cd9-463e-b92d-60d2e6b970cd tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:24.117480 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c02350ff-6cd9-463e-b92d-60d2e6b970cd tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:24.200573 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c02350ff-6cd9-463e-b92d-60d2e6b970cd tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:24.216009 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c02350ff-6cd9-463e-b92d-60d2e6b970cd tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1221 microversion: 2.1 time: 0.109361 Apr 08 02:45:24.216754 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 62/131] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:24 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1221 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:25.234171 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1f708769-f2d6-4aac-ab75-fea911e00a97 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:25.234882 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1f708769-f2d6-4aac-ab75-fea911e00a97 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:25.255897 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1f708769-f2d6-4aac-ab75-fea911e00a97 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:25.256404 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1f708769-f2d6-4aac-ab75-fea911e00a97 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:25.257159 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1f708769-f2d6-4aac-ab75-fea911e00a97 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:25.257587 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1f708769-f2d6-4aac-ab75-fea911e00a97 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:25.468477 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1f708769-f2d6-4aac-ab75-fea911e00a97 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:25.476977 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1f708769-f2d6-4aac-ab75-fea911e00a97 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1273 microversion: 2.1 time: 0.247856 Apr 08 02:45:25.477770 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 70/132] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:25 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:26.500523 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-496a050d-890d-4025-bf13-bc6e558af3b5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:26.501955 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-496a050d-890d-4025-bf13-bc6e558af3b5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:26.517848 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-496a050d-890d-4025-bf13-bc6e558af3b5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:26.524971 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-496a050d-890d-4025-bf13-bc6e558af3b5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:26.526487 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-496a050d-890d-4025-bf13-bc6e558af3b5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:26.527062 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-496a050d-890d-4025-bf13-bc6e558af3b5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:26.814447 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-496a050d-890d-4025-bf13-bc6e558af3b5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:26.830610 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-496a050d-890d-4025-bf13-bc6e558af3b5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1279 microversion: 2.1 time: 0.339181 Apr 08 02:45:26.840709 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 63/133] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:26 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1279 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:27.581006 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-75bfeea7-00d1-4789-8a7d-ba506b366991 req-97f0a7e5-3484-4c98-bbb7-80b167f00ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96569291-3f37-4b65-b902-9e31040c4328", "tag": "2437d107-0e71-4cd9-bfef-38bb3ccc9385"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:27.583222 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:45:27.583222 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:45:27.624517 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-75bfeea7-00d1-4789-8a7d-ba506b366991 req-97f0a7e5-3484-4c98-bbb7-80b167f00ea8 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:27.627007 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-75bfeea7-00d1-4789-8a7d-ba506b366991 req-97f0a7e5-3484-4c98-bbb7-80b167f00ea8 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:27.681200 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-75bfeea7-00d1-4789-8a7d-ba506b366991 req-97f0a7e5-3484-4c98-bbb7-80b167f00ea8 service nova] Creating event network-changed:2437d107-0e71-4cd9-bfef-38bb3ccc9385 for instance 96569291-3f37-4b65-b902-9e31040c4328 on hv-cinder-83705 Apr 08 02:45:27.691153 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-75bfeea7-00d1-4789-8a7d-ba506b366991 req-97f0a7e5-3484-4c98-bbb7-80b167f00ea8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127118 Apr 08 02:45:27.692824 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 71/134] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:45:27.847627 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4058dc40-c401-471f-a455-64400395f6b3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:27.848273 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-4058dc40-c401-471f-a455-64400395f6b3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:27.862732 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4058dc40-c401-471f-a455-64400395f6b3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:27.863186 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4058dc40-c401-471f-a455-64400395f6b3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:27.864001 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4058dc40-c401-471f-a455-64400395f6b3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:27.864438 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4058dc40-c401-471f-a455-64400395f6b3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:28.452108 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4058dc40-c401-471f-a455-64400395f6b3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:28.464543 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4058dc40-c401-471f-a455-64400395f6b3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.620462 Apr 08 02:45:28.474049 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 64/135] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:27 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:29.190666 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-786935e6-2c89-45d5-b878-bfebe509c0d3 req-16e4bd38-591b-4240-be31-edd48a3824dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71445bb3-86a1-47f4-a31d-f5d7fada20bd", "tag": "d3a8eac8-aa70-41c5-92be-ee364676a64e"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:29.193372 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:45:29.193372 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:45:29.212028 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-786935e6-2c89-45d5-b878-bfebe509c0d3 req-16e4bd38-591b-4240-be31-edd48a3824dc service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:29.217031 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-786935e6-2c89-45d5-b878-bfebe509c0d3 req-16e4bd38-591b-4240-be31-edd48a3824dc service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:29.256950 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-786935e6-2c89-45d5-b878-bfebe509c0d3 req-16e4bd38-591b-4240-be31-edd48a3824dc service nova] Creating event network-changed:d3a8eac8-aa70-41c5-92be-ee364676a64e for instance 71445bb3-86a1-47f4-a31d-f5d7fada20bd on hv-cinder-83705 Apr 08 02:45:29.267172 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-786935e6-2c89-45d5-b878-bfebe509c0d3 req-16e4bd38-591b-4240-be31-edd48a3824dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080451 Apr 08 02:45:29.267779 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 72/136] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:45:29.482674 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c289e19d-2494-43c1-b757-31ddce87dce5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:29.483281 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c289e19d-2494-43c1-b757-31ddce87dce5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:29.498036 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c289e19d-2494-43c1-b757-31ddce87dce5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:29.498707 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c289e19d-2494-43c1-b757-31ddce87dce5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:29.502297 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c289e19d-2494-43c1-b757-31ddce87dce5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:29.503043 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c289e19d-2494-43c1-b757-31ddce87dce5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:29.963501 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c289e19d-2494-43c1-b757-31ddce87dce5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:29.971738 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c289e19d-2494-43c1-b757-31ddce87dce5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.493909 Apr 08 02:45:29.972488 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 65/137] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:29 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:30.989760 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0599cb65-430b-4c1a-9d67-7311477c6594 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:30.990602 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0599cb65-430b-4c1a-9d67-7311477c6594 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:30.998439 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0599cb65-430b-4c1a-9d67-7311477c6594 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:30.999147 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0599cb65-430b-4c1a-9d67-7311477c6594 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:31.000295 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0599cb65-430b-4c1a-9d67-7311477c6594 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:31.000888 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0599cb65-430b-4c1a-9d67-7311477c6594 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:31.519999 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0599cb65-430b-4c1a-9d67-7311477c6594 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:31.531080 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0599cb65-430b-4c1a-9d67-7311477c6594 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.544946 Apr 08 02:45:31.544086 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 73/138] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:30 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:32.548817 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d93485ba-5d3a-49ac-88b9-6fe1c17aaaa5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:32.549952 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-d93485ba-5d3a-49ac-88b9-6fe1c17aaaa5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:32.558848 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d93485ba-5d3a-49ac-88b9-6fe1c17aaaa5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:32.558848 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d93485ba-5d3a-49ac-88b9-6fe1c17aaaa5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:32.561000 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d93485ba-5d3a-49ac-88b9-6fe1c17aaaa5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:32.561679 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d93485ba-5d3a-49ac-88b9-6fe1c17aaaa5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:32.775655 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-d93485ba-5d3a-49ac-88b9-6fe1c17aaaa5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:32.784401 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-d93485ba-5d3a-49ac-88b9-6fe1c17aaaa5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.239721 Apr 08 02:45:32.784961 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 66/139] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:32 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:33.804312 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b2bb7684-9340-4923-92b6-ce8407a6437e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:33.805683 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b2bb7684-9340-4923-92b6-ce8407a6437e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:33.817759 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b2bb7684-9340-4923-92b6-ce8407a6437e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:33.818318 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b2bb7684-9340-4923-92b6-ce8407a6437e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:33.819417 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b2bb7684-9340-4923-92b6-ce8407a6437e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:33.820108 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b2bb7684-9340-4923-92b6-ce8407a6437e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:34.087504 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b2bb7684-9340-4923-92b6-ce8407a6437e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:34.097258 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b2bb7684-9340-4923-92b6-ce8407a6437e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.298955 Apr 08 02:45:34.097887 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 74/140] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:33 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:35.114354 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-08db76b0-6c36-4c77-acb8-bb6d113631d5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:35.115129 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-08db76b0-6c36-4c77-acb8-bb6d113631d5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:35.123057 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-08db76b0-6c36-4c77-acb8-bb6d113631d5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:35.123503 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-08db76b0-6c36-4c77-acb8-bb6d113631d5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:35.124416 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-08db76b0-6c36-4c77-acb8-bb6d113631d5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:35.124850 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-08db76b0-6c36-4c77-acb8-bb6d113631d5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:35.362068 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-08db76b0-6c36-4c77-acb8-bb6d113631d5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:35.370219 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-08db76b0-6c36-4c77-acb8-bb6d113631d5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.259480 Apr 08 02:45:35.370704 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 67/141] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:35 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:36.386312 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-57df806f-9425-4f6a-a1c3-66e7a193cdf4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:36.387062 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-57df806f-9425-4f6a-a1c3-66e7a193cdf4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:36.398284 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-57df806f-9425-4f6a-a1c3-66e7a193cdf4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:36.398813 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-57df806f-9425-4f6a-a1c3-66e7a193cdf4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:36.399487 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-57df806f-9425-4f6a-a1c3-66e7a193cdf4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:36.399919 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-57df806f-9425-4f6a-a1c3-66e7a193cdf4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:36.615271 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-57df806f-9425-4f6a-a1c3-66e7a193cdf4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:36.625686 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-57df806f-9425-4f6a-a1c3-66e7a193cdf4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.243007 Apr 08 02:45:36.626328 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 75/142] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:36 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:37.642134 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e9b187a5-cda6-49c2-bc1b-c4db7eee6576 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:37.642750 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e9b187a5-cda6-49c2-bc1b-c4db7eee6576 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:37.649973 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e9b187a5-cda6-49c2-bc1b-c4db7eee6576 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:37.650372 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e9b187a5-cda6-49c2-bc1b-c4db7eee6576 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:37.651137 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e9b187a5-cda6-49c2-bc1b-c4db7eee6576 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:37.651573 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e9b187a5-cda6-49c2-bc1b-c4db7eee6576 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:37.843125 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e9b187a5-cda6-49c2-bc1b-c4db7eee6576 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:37.851147 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e9b187a5-cda6-49c2-bc1b-c4db7eee6576 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.212640 Apr 08 02:45:37.851718 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 68/143] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:37 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:38.868302 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-aad23e52-60cb-4ad2-be03-5edf3e532822 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:38.868929 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-aad23e52-60cb-4ad2-be03-5edf3e532822 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:38.876141 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aad23e52-60cb-4ad2-be03-5edf3e532822 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:38.876587 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aad23e52-60cb-4ad2-be03-5edf3e532822 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:38.877345 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aad23e52-60cb-4ad2-be03-5edf3e532822 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:38.877775 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aad23e52-60cb-4ad2-be03-5edf3e532822 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:39.068327 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-aad23e52-60cb-4ad2-be03-5edf3e532822 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:39.077016 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-aad23e52-60cb-4ad2-be03-5edf3e532822 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.212561 Apr 08 02:45:39.077579 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 76/144] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:38 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:40.093389 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-29c56724-1bf2-4bd0-9736-f0778a730a61 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:40.094005 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-29c56724-1bf2-4bd0-9736-f0778a730a61 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:40.101312 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-29c56724-1bf2-4bd0-9736-f0778a730a61 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:40.101761 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-29c56724-1bf2-4bd0-9736-f0778a730a61 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:40.102522 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-29c56724-1bf2-4bd0-9736-f0778a730a61 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:40.102956 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-29c56724-1bf2-4bd0-9736-f0778a730a61 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:40.296586 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-29c56724-1bf2-4bd0-9736-f0778a730a61 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:40.305573 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-29c56724-1bf2-4bd0-9736-f0778a730a61 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.216465 Apr 08 02:45:40.306145 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 69/145] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:40 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:41.204421 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-5018b14d-5061-402d-807b-141c9b367789 req-2753eac8-7f09-493e-b0a2-259620cdce37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71445bb3-86a1-47f4-a31d-f5d7fada20bd", "name": "network-vif-plugged", "status": "completed", "tag": "d3a8eac8-aa70-41c5-92be-ee364676a64e"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:41.205900 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:45:41.205900 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:45:41.214180 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-5018b14d-5061-402d-807b-141c9b367789 req-2753eac8-7f09-493e-b0a2-259620cdce37 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:41.214626 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-5018b14d-5061-402d-807b-141c9b367789 req-2753eac8-7f09-493e-b0a2-259620cdce37 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:41.231997 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-5018b14d-5061-402d-807b-141c9b367789 req-2753eac8-7f09-493e-b0a2-259620cdce37 service nova] Creating event network-vif-plugged:d3a8eac8-aa70-41c5-92be-ee364676a64e for instance 71445bb3-86a1-47f4-a31d-f5d7fada20bd on hv-cinder-83705 Apr 08 02:45:41.236793 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-5018b14d-5061-402d-807b-141c9b367789 req-2753eac8-7f09-493e-b0a2-259620cdce37 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037570 Apr 08 02:45:41.237565 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 77/146] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:45:41.322490 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-0b9ded32-1cdc-4e1a-bc2c-80b20e8524ca tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:41.323094 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-0b9ded32-1cdc-4e1a-bc2c-80b20e8524ca tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:41.330794 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0b9ded32-1cdc-4e1a-bc2c-80b20e8524ca tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:41.331237 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0b9ded32-1cdc-4e1a-bc2c-80b20e8524ca tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:41.332030 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0b9ded32-1cdc-4e1a-bc2c-80b20e8524ca tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:41.332696 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0b9ded32-1cdc-4e1a-bc2c-80b20e8524ca tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:41.543274 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0b9ded32-1cdc-4e1a-bc2c-80b20e8524ca tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:41.553942 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-0b9ded32-1cdc-4e1a-bc2c-80b20e8524ca tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.233481 Apr 08 02:45:41.555079 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 70/147] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:41 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:42.572773 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5f8ceb35-7c2e-4535-870c-06562e8568af tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:42.573544 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5f8ceb35-7c2e-4535-870c-06562e8568af tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:42.581513 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5f8ceb35-7c2e-4535-870c-06562e8568af tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:42.581950 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5f8ceb35-7c2e-4535-870c-06562e8568af tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:42.582710 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5f8ceb35-7c2e-4535-870c-06562e8568af tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:42.583151 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5f8ceb35-7c2e-4535-870c-06562e8568af tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:42.782765 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5f8ceb35-7c2e-4535-870c-06562e8568af tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:42.790891 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5f8ceb35-7c2e-4535-870c-06562e8568af tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.222305 Apr 08 02:45:42.791440 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 78/148] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:42 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:43.250277 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-ab85d7c0-18f1-46a8-ad95-b6c0d48a3ccc req-7e1a8fed-4fd5-41b4-8e83-19326caae288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96569291-3f37-4b65-b902-9e31040c4328", "name": "network-vif-plugged", "status": "completed", "tag": "2437d107-0e71-4cd9-bfef-38bb3ccc9385"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:43.251850 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:45:43.251850 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:45:43.260032 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-ab85d7c0-18f1-46a8-ad95-b6c0d48a3ccc req-7e1a8fed-4fd5-41b4-8e83-19326caae288 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:43.260482 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-ab85d7c0-18f1-46a8-ad95-b6c0d48a3ccc req-7e1a8fed-4fd5-41b4-8e83-19326caae288 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:43.275696 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-ab85d7c0-18f1-46a8-ad95-b6c0d48a3ccc req-7e1a8fed-4fd5-41b4-8e83-19326caae288 service nova] Creating event network-vif-plugged:2437d107-0e71-4cd9-bfef-38bb3ccc9385 for instance 96569291-3f37-4b65-b902-9e31040c4328 on hv-cinder-83705 Apr 08 02:45:43.281385 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-ab85d7c0-18f1-46a8-ad95-b6c0d48a3ccc req-7e1a8fed-4fd5-41b4-8e83-19326caae288 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034741 Apr 08 02:45:43.281963 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 71/149] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:45:43.808691 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c8c24caa-0978-430c-ae14-ba98bd062287 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:43.809939 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c8c24caa-0978-430c-ae14-ba98bd062287 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:43.817851 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c8c24caa-0978-430c-ae14-ba98bd062287 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:43.818345 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c8c24caa-0978-430c-ae14-ba98bd062287 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:43.819594 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c8c24caa-0978-430c-ae14-ba98bd062287 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:43.820320 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c8c24caa-0978-430c-ae14-ba98bd062287 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:44.064040 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c8c24caa-0978-430c-ae14-ba98bd062287 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:44.073458 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c8c24caa-0978-430c-ae14-ba98bd062287 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.268371 Apr 08 02:45:44.075185 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 79/150] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:43 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:45.093033 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-51199151-2940-44ed-a4d6-4677a6c9c232 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:45.093729 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-51199151-2940-44ed-a4d6-4677a6c9c232 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:45.101110 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-51199151-2940-44ed-a4d6-4677a6c9c232 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:45.101559 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-51199151-2940-44ed-a4d6-4677a6c9c232 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:45.102372 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-51199151-2940-44ed-a4d6-4677a6c9c232 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:45.102761 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-51199151-2940-44ed-a4d6-4677a6c9c232 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:45.305873 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-51199151-2940-44ed-a4d6-4677a6c9c232 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:45.314279 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-51199151-2940-44ed-a4d6-4677a6c9c232 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.225808 Apr 08 02:45:45.314861 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 72/151] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:45 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:46.330783 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c9d964ad-f76e-4353-95d5-5bfbbb5b6945 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:46.331398 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c9d964ad-f76e-4353-95d5-5bfbbb5b6945 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:46.338643 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c9d964ad-f76e-4353-95d5-5bfbbb5b6945 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:46.339089 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c9d964ad-f76e-4353-95d5-5bfbbb5b6945 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:46.339912 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c9d964ad-f76e-4353-95d5-5bfbbb5b6945 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:46.340363 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c9d964ad-f76e-4353-95d5-5bfbbb5b6945 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:46.537261 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c9d964ad-f76e-4353-95d5-5bfbbb5b6945 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:46.546149 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c9d964ad-f76e-4353-95d5-5bfbbb5b6945 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.219022 Apr 08 02:45:46.546710 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 80/152] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:46 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:47.562805 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-04600ee8-cb7c-42a4-b84a-846771329f4b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:47.563423 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-04600ee8-cb7c-42a4-b84a-846771329f4b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:47.570554 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-04600ee8-cb7c-42a4-b84a-846771329f4b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:47.571002 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-04600ee8-cb7c-42a4-b84a-846771329f4b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:47.571773 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-04600ee8-cb7c-42a4-b84a-846771329f4b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:47.572249 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-04600ee8-cb7c-42a4-b84a-846771329f4b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:47.763334 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-04600ee8-cb7c-42a4-b84a-846771329f4b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:47.771295 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-04600ee8-cb7c-42a4-b84a-846771329f4b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.212758 Apr 08 02:45:47.771860 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 73/153] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:47 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:48.788484 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5674daab-5ce1-4695-afa8-913d5da3fbaf tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:48.789018 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5674daab-5ce1-4695-afa8-913d5da3fbaf tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:48.797173 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5674daab-5ce1-4695-afa8-913d5da3fbaf tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:48.797612 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5674daab-5ce1-4695-afa8-913d5da3fbaf tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:48.798358 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5674daab-5ce1-4695-afa8-913d5da3fbaf tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:48.798783 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5674daab-5ce1-4695-afa8-913d5da3fbaf tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:48.997507 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5674daab-5ce1-4695-afa8-913d5da3fbaf tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:49.005580 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5674daab-5ce1-4695-afa8-913d5da3fbaf tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1321 microversion: 2.1 time: 0.220803 Apr 08 02:45:49.006138 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 81/154] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:48 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:50.021243 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ca177511-d562-4b34-b2e3-9cd52560811e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:50.021884 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ca177511-d562-4b34-b2e3-9cd52560811e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:50.029986 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ca177511-d562-4b34-b2e3-9cd52560811e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:50.030476 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ca177511-d562-4b34-b2e3-9cd52560811e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:50.031236 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ca177511-d562-4b34-b2e3-9cd52560811e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:50.031671 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ca177511-d562-4b34-b2e3-9cd52560811e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:50.225113 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ca177511-d562-4b34-b2e3-9cd52560811e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:50.234469 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ca177511-d562-4b34-b2e3-9cd52560811e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1515 microversion: 2.1 time: 0.216812 Apr 08 02:45:50.235035 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 74/155] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:50 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:50.252647 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-aab6c550-e0e0-45de-a980-6fd251deb4d5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:50.253519 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-aab6c550-e0e0-45de-a980-6fd251deb4d5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:50.266327 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aab6c550-e0e0-45de-a980-6fd251deb4d5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:50.266775 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aab6c550-e0e0-45de-a980-6fd251deb4d5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:50.269093 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aab6c550-e0e0-45de-a980-6fd251deb4d5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:50.269533 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aab6c550-e0e0-45de-a980-6fd251deb4d5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:50.330525 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.objects.instance [None req-aab6c550-e0e0-45de-a980-6fd251deb4d5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lazy-loading 'flavor' on Instance uuid 71445bb3-86a1-47f4-a31d-f5d7fada20bd {{(pid=101272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:45:50.472486 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-aab6c550-e0e0-45de-a980-6fd251deb4d5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "POST /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd/action" status: 200 len: 32 microversion: 2.1 time: 0.223907 Apr 08 02:45:50.473677 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 82/156] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Apr 8 02:45:50 2022] POST /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd/action => generated 32 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:45:50.482751 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-cfbe13a8-584e-4787-98f8-a06cc3f301ac tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:50.483616 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-cfbe13a8-584e-4787-98f8-a06cc3f301ac tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:50.491779 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cfbe13a8-584e-4787-98f8-a06cc3f301ac tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:50.492478 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cfbe13a8-584e-4787-98f8-a06cc3f301ac tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:50.493670 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cfbe13a8-584e-4787-98f8-a06cc3f301ac tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:50.494159 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cfbe13a8-584e-4787-98f8-a06cc3f301ac tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:50.740899 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-cfbe13a8-584e-4787-98f8-a06cc3f301ac tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:50.750449 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-cfbe13a8-584e-4787-98f8-a06cc3f301ac tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.271852 Apr 08 02:45:50.751087 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 75/157] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:50 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:51.768438 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-66a0c426-1220-456c-ba1d-2323696680e3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:51.769066 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-66a0c426-1220-456c-ba1d-2323696680e3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:51.777249 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-66a0c426-1220-456c-ba1d-2323696680e3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:51.777692 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-66a0c426-1220-456c-ba1d-2323696680e3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:51.778616 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-66a0c426-1220-456c-ba1d-2323696680e3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:51.779045 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-66a0c426-1220-456c-ba1d-2323696680e3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:52.041684 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-66a0c426-1220-456c-ba1d-2323696680e3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:52.050232 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-66a0c426-1220-456c-ba1d-2323696680e3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.286076 Apr 08 02:45:52.050833 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 83/158] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:51 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:53.068088 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-64123c45-35c0-46bf-a597-20b92c44a549 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:53.068636 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-64123c45-35c0-46bf-a597-20b92c44a549 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:53.075797 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-64123c45-35c0-46bf-a597-20b92c44a549 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:53.076273 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-64123c45-35c0-46bf-a597-20b92c44a549 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:53.077034 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-64123c45-35c0-46bf-a597-20b92c44a549 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:53.077469 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-64123c45-35c0-46bf-a597-20b92c44a549 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:53.272828 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-64123c45-35c0-46bf-a597-20b92c44a549 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:53.281608 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-64123c45-35c0-46bf-a597-20b92c44a549 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.217438 Apr 08 02:45:53.282177 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 76/159] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:53 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:54.298369 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0f7fa9ed-3630-43d9-8cc0-881fabfdfd94 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:54.298985 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0f7fa9ed-3630-43d9-8cc0-881fabfdfd94 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:54.306838 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0f7fa9ed-3630-43d9-8cc0-881fabfdfd94 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:54.307284 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0f7fa9ed-3630-43d9-8cc0-881fabfdfd94 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:54.308078 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0f7fa9ed-3630-43d9-8cc0-881fabfdfd94 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:54.309129 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0f7fa9ed-3630-43d9-8cc0-881fabfdfd94 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:54.505668 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0f7fa9ed-3630-43d9-8cc0-881fabfdfd94 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:54.514117 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0f7fa9ed-3630-43d9-8cc0-881fabfdfd94 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.219426 Apr 08 02:45:54.514677 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 84/160] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:54 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:55.531183 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-0de75a68-a349-43fc-935f-80bff93d3f36 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:55.531837 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-0de75a68-a349-43fc-935f-80bff93d3f36 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:55.539097 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0de75a68-a349-43fc-935f-80bff93d3f36 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:55.539553 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0de75a68-a349-43fc-935f-80bff93d3f36 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:55.540343 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0de75a68-a349-43fc-935f-80bff93d3f36 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:55.540781 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0de75a68-a349-43fc-935f-80bff93d3f36 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:55.735685 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0de75a68-a349-43fc-935f-80bff93d3f36 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:55.743705 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-0de75a68-a349-43fc-935f-80bff93d3f36 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.216636 Apr 08 02:45:55.744293 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 77/161] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:55 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:56.761993 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-84ce730b-3232-404a-8a23-4272239ff501 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:56.762665 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-84ce730b-3232-404a-8a23-4272239ff501 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:56.769904 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-84ce730b-3232-404a-8a23-4272239ff501 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:56.770344 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-84ce730b-3232-404a-8a23-4272239ff501 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:56.771096 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-84ce730b-3232-404a-8a23-4272239ff501 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:56.771526 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-84ce730b-3232-404a-8a23-4272239ff501 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:56.966160 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-84ce730b-3232-404a-8a23-4272239ff501 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:56.974225 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-84ce730b-3232-404a-8a23-4272239ff501 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.216627 Apr 08 02:45:56.974780 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 85/162] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:56 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:57.990512 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ecf0e7ce-1a02-4e90-92ed-f9df66652789 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:57.991144 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ecf0e7ce-1a02-4e90-92ed-f9df66652789 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:57.998981 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ecf0e7ce-1a02-4e90-92ed-f9df66652789 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:57.999423 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ecf0e7ce-1a02-4e90-92ed-f9df66652789 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:58.000208 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ecf0e7ce-1a02-4e90-92ed-f9df66652789 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:58.000646 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ecf0e7ce-1a02-4e90-92ed-f9df66652789 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:58.194873 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ecf0e7ce-1a02-4e90-92ed-f9df66652789 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:58.203394 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ecf0e7ce-1a02-4e90-92ed-f9df66652789 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.216539 Apr 08 02:45:58.203977 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 78/163] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:57 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:59.221134 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-cd526807-b9ec-45e2-b2cc-46b1a96b734e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:59.221683 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-cd526807-b9ec-45e2-b2cc-46b1a96b734e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:45:59.228810 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cd526807-b9ec-45e2-b2cc-46b1a96b734e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:59.229249 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cd526807-b9ec-45e2-b2cc-46b1a96b734e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:59.230001 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cd526807-b9ec-45e2-b2cc-46b1a96b734e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:59.230426 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cd526807-b9ec-45e2-b2cc-46b1a96b734e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:59.425906 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cd526807-b9ec-45e2-b2cc-46b1a96b734e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:45:59.434565 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-cd526807-b9ec-45e2-b2cc-46b1a96b734e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.217551 Apr 08 02:45:59.435128 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 86/164] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:59 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:00.451935 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-92b83252-6f1c-4e08-a4e7-a0efe8fb13f4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:00.452563 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-92b83252-6f1c-4e08-a4e7-a0efe8fb13f4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:00.459656 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-92b83252-6f1c-4e08-a4e7-a0efe8fb13f4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:00.460129 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-92b83252-6f1c-4e08-a4e7-a0efe8fb13f4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:00.460914 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-92b83252-6f1c-4e08-a4e7-a0efe8fb13f4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:00.461339 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-92b83252-6f1c-4e08-a4e7-a0efe8fb13f4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:00.658254 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-92b83252-6f1c-4e08-a4e7-a0efe8fb13f4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:00.666343 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-92b83252-6f1c-4e08-a4e7-a0efe8fb13f4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.219433 Apr 08 02:46:00.666932 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 79/165] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:00 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:01.684013 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-272eced3-63b7-4f18-87ff-3bc83cddca93 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:01.684551 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-272eced3-63b7-4f18-87ff-3bc83cddca93 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:01.691681 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-272eced3-63b7-4f18-87ff-3bc83cddca93 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:01.692171 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-272eced3-63b7-4f18-87ff-3bc83cddca93 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:01.692939 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-272eced3-63b7-4f18-87ff-3bc83cddca93 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:01.693402 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-272eced3-63b7-4f18-87ff-3bc83cddca93 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:01.887234 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-272eced3-63b7-4f18-87ff-3bc83cddca93 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:01.895513 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-272eced3-63b7-4f18-87ff-3bc83cddca93 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.215734 Apr 08 02:46:01.896101 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 87/166] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:01 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:02.912695 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ee913aa0-1c20-4123-a091-cde776b767ca tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:02.913233 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ee913aa0-1c20-4123-a091-cde776b767ca tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:02.921064 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ee913aa0-1c20-4123-a091-cde776b767ca tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:02.921515 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ee913aa0-1c20-4123-a091-cde776b767ca tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:02.922277 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ee913aa0-1c20-4123-a091-cde776b767ca tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:02.922715 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ee913aa0-1c20-4123-a091-cde776b767ca tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:03.182350 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ee913aa0-1c20-4123-a091-cde776b767ca tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:03.191266 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ee913aa0-1c20-4123-a091-cde776b767ca tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.282311 Apr 08 02:46:03.191829 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 80/167] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:02 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:04.207512 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-af03f478-ac19-4dd0-88c4-46d08d3778fa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:04.208171 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-af03f478-ac19-4dd0-88c4-46d08d3778fa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:04.216216 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-af03f478-ac19-4dd0-88c4-46d08d3778fa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:04.216665 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-af03f478-ac19-4dd0-88c4-46d08d3778fa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:04.217423 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-af03f478-ac19-4dd0-88c4-46d08d3778fa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:04.217857 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-af03f478-ac19-4dd0-88c4-46d08d3778fa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:04.411672 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-af03f478-ac19-4dd0-88c4-46d08d3778fa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:04.420355 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-af03f478-ac19-4dd0-88c4-46d08d3778fa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.216486 Apr 08 02:46:04.420914 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 88/168] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:04 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:05.437920 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c420a531-ac6a-4f64-86a6-81c9606a8f03 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:05.438644 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c420a531-ac6a-4f64-86a6-81c9606a8f03 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:05.445899 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c420a531-ac6a-4f64-86a6-81c9606a8f03 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:05.446342 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c420a531-ac6a-4f64-86a6-81c9606a8f03 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:05.447103 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c420a531-ac6a-4f64-86a6-81c9606a8f03 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:05.447856 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c420a531-ac6a-4f64-86a6-81c9606a8f03 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:05.645622 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c420a531-ac6a-4f64-86a6-81c9606a8f03 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:05.654635 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c420a531-ac6a-4f64-86a6-81c9606a8f03 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.220994 Apr 08 02:46:05.655199 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 81/169] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:05 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:06.670837 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-60d7fd11-ba16-42a7-b874-d6989dd99439 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:06.671439 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-60d7fd11-ba16-42a7-b874-d6989dd99439 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:06.678949 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-60d7fd11-ba16-42a7-b874-d6989dd99439 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:06.679414 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-60d7fd11-ba16-42a7-b874-d6989dd99439 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:06.680182 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-60d7fd11-ba16-42a7-b874-d6989dd99439 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:06.680611 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-60d7fd11-ba16-42a7-b874-d6989dd99439 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:06.872079 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-60d7fd11-ba16-42a7-b874-d6989dd99439 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:06.880158 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-60d7fd11-ba16-42a7-b874-d6989dd99439 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.213532 Apr 08 02:46:06.880715 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 89/170] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:06 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:07.897017 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4cc545f1-d1ef-475b-9cfa-2bdc5bc54fe7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:07.897805 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-4cc545f1-d1ef-475b-9cfa-2bdc5bc54fe7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:07.905346 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4cc545f1-d1ef-475b-9cfa-2bdc5bc54fe7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:07.905798 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4cc545f1-d1ef-475b-9cfa-2bdc5bc54fe7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:07.906563 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4cc545f1-d1ef-475b-9cfa-2bdc5bc54fe7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:07.906996 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4cc545f1-d1ef-475b-9cfa-2bdc5bc54fe7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:08.114835 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4cc545f1-d1ef-475b-9cfa-2bdc5bc54fe7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:08.123593 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4cc545f1-d1ef-475b-9cfa-2bdc5bc54fe7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.230396 Apr 08 02:46:08.124194 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 82/171] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:07 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:09.140711 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-8e430ce5-8f23-4345-a615-bab0e80e9cd2 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:09.141354 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-8e430ce5-8f23-4345-a615-bab0e80e9cd2 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:09.148372 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8e430ce5-8f23-4345-a615-bab0e80e9cd2 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:09.148813 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8e430ce5-8f23-4345-a615-bab0e80e9cd2 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:09.149562 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8e430ce5-8f23-4345-a615-bab0e80e9cd2 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:09.149991 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8e430ce5-8f23-4345-a615-bab0e80e9cd2 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:09.344871 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-8e430ce5-8f23-4345-a615-bab0e80e9cd2 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:09.352973 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-8e430ce5-8f23-4345-a615-bab0e80e9cd2 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.216565 Apr 08 02:46:09.353532 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 90/172] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:09 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:10.369907 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e8afdc6a-e641-49fe-acc0-b8083c2c4339 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:10.370541 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e8afdc6a-e641-49fe-acc0-b8083c2c4339 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:10.377968 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e8afdc6a-e641-49fe-acc0-b8083c2c4339 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:10.378410 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e8afdc6a-e641-49fe-acc0-b8083c2c4339 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:10.379160 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e8afdc6a-e641-49fe-acc0-b8083c2c4339 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:10.379585 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e8afdc6a-e641-49fe-acc0-b8083c2c4339 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:10.585411 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e8afdc6a-e641-49fe-acc0-b8083c2c4339 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:10.596162 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e8afdc6a-e641-49fe-acc0-b8083c2c4339 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.229888 Apr 08 02:46:10.596763 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 83/173] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:10 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:11.614614 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c94ac340-f674-4789-9f10-9cc59f0c1b26 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:11.615104 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c94ac340-f674-4789-9f10-9cc59f0c1b26 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:11.623603 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c94ac340-f674-4789-9f10-9cc59f0c1b26 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:11.624086 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c94ac340-f674-4789-9f10-9cc59f0c1b26 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:11.624853 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c94ac340-f674-4789-9f10-9cc59f0c1b26 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:11.625385 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c94ac340-f674-4789-9f10-9cc59f0c1b26 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:11.820962 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c94ac340-f674-4789-9f10-9cc59f0c1b26 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:11.829799 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c94ac340-f674-4789-9f10-9cc59f0c1b26 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.219302 Apr 08 02:46:11.830360 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 91/174] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:11 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:12.847338 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-60e71319-d4ed-4bbc-9d25-d297729491b3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:12.848054 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-60e71319-d4ed-4bbc-9d25-d297729491b3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:12.855408 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-60e71319-d4ed-4bbc-9d25-d297729491b3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:12.855853 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-60e71319-d4ed-4bbc-9d25-d297729491b3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:12.857219 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-60e71319-d4ed-4bbc-9d25-d297729491b3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:12.857651 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-60e71319-d4ed-4bbc-9d25-d297729491b3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:13.061696 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-60e71319-d4ed-4bbc-9d25-d297729491b3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:13.070525 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-60e71319-d4ed-4bbc-9d25-d297729491b3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.226387 Apr 08 02:46:13.070525 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 84/175] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:12 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:14.086793 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f11bc106-2ad8-40d8-8a5b-21bcaec2210a tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:14.087400 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f11bc106-2ad8-40d8-8a5b-21bcaec2210a tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:14.095173 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f11bc106-2ad8-40d8-8a5b-21bcaec2210a tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:14.095613 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f11bc106-2ad8-40d8-8a5b-21bcaec2210a tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:14.096398 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f11bc106-2ad8-40d8-8a5b-21bcaec2210a tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:14.096829 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f11bc106-2ad8-40d8-8a5b-21bcaec2210a tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:14.289753 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f11bc106-2ad8-40d8-8a5b-21bcaec2210a tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:14.297855 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f11bc106-2ad8-40d8-8a5b-21bcaec2210a tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.214732 Apr 08 02:46:14.298407 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 92/176] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:14 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:15.315152 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-971febe1-c25b-4e17-90f1-883a02ecd2e6 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:15.315762 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-971febe1-c25b-4e17-90f1-883a02ecd2e6 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:15.323239 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-971febe1-c25b-4e17-90f1-883a02ecd2e6 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:15.323688 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-971febe1-c25b-4e17-90f1-883a02ecd2e6 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:15.324482 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-971febe1-c25b-4e17-90f1-883a02ecd2e6 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:15.324913 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-971febe1-c25b-4e17-90f1-883a02ecd2e6 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:15.521823 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-971febe1-c25b-4e17-90f1-883a02ecd2e6 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:15.529927 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-971febe1-c25b-4e17-90f1-883a02ecd2e6 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.218566 Apr 08 02:46:15.530487 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 85/177] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:15 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:16.546565 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-582c5027-446c-4460-8c16-b3e7ad42d9d9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:16.547090 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-582c5027-446c-4460-8c16-b3e7ad42d9d9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:16.554567 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-582c5027-446c-4460-8c16-b3e7ad42d9d9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:16.555016 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-582c5027-446c-4460-8c16-b3e7ad42d9d9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:16.555774 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-582c5027-446c-4460-8c16-b3e7ad42d9d9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:16.556235 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-582c5027-446c-4460-8c16-b3e7ad42d9d9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:16.754121 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-582c5027-446c-4460-8c16-b3e7ad42d9d9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:16.762165 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-582c5027-446c-4460-8c16-b3e7ad42d9d9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.219442 Apr 08 02:46:16.762716 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 93/178] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:16 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:17.780088 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-427b21ad-6e08-44af-8c18-12106ffa7ca7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:17.780919 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-427b21ad-6e08-44af-8c18-12106ffa7ca7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:17.788146 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-427b21ad-6e08-44af-8c18-12106ffa7ca7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:17.788591 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-427b21ad-6e08-44af-8c18-12106ffa7ca7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:17.789350 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-427b21ad-6e08-44af-8c18-12106ffa7ca7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:17.789792 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-427b21ad-6e08-44af-8c18-12106ffa7ca7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:17.986845 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-427b21ad-6e08-44af-8c18-12106ffa7ca7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:17.994849 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-427b21ad-6e08-44af-8c18-12106ffa7ca7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.219460 Apr 08 02:46:17.995410 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 86/179] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:17 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:19.012177 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c5e6dff0-333a-401a-bdf6-255879f75770 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:19.012715 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c5e6dff0-333a-401a-bdf6-255879f75770 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:19.020644 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c5e6dff0-333a-401a-bdf6-255879f75770 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:19.021093 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c5e6dff0-333a-401a-bdf6-255879f75770 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:19.021855 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c5e6dff0-333a-401a-bdf6-255879f75770 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:19.022288 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c5e6dff0-333a-401a-bdf6-255879f75770 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:19.233249 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c5e6dff0-333a-401a-bdf6-255879f75770 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:19.241345 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c5e6dff0-333a-401a-bdf6-255879f75770 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.232875 Apr 08 02:46:19.241902 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 94/180] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:19 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:20.258716 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-378aa00d-2a68-4929-b536-c2fac62e5d1b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:20.259273 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-378aa00d-2a68-4929-b536-c2fac62e5d1b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:20.266962 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-378aa00d-2a68-4929-b536-c2fac62e5d1b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:20.267404 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-378aa00d-2a68-4929-b536-c2fac62e5d1b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:20.268187 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-378aa00d-2a68-4929-b536-c2fac62e5d1b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:20.268619 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-378aa00d-2a68-4929-b536-c2fac62e5d1b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:20.459178 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-378aa00d-2a68-4929-b536-c2fac62e5d1b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:20.468237 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-378aa00d-2a68-4929-b536-c2fac62e5d1b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.213204 Apr 08 02:46:20.469019 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 87/181] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:20 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:21.485418 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-a6dcf785-6133-443b-8263-b5343561341b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:21.486046 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-a6dcf785-6133-443b-8263-b5343561341b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:21.493593 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a6dcf785-6133-443b-8263-b5343561341b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:21.494272 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a6dcf785-6133-443b-8263-b5343561341b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:21.495125 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a6dcf785-6133-443b-8263-b5343561341b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:21.495568 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a6dcf785-6133-443b-8263-b5343561341b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:21.755422 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a6dcf785-6133-443b-8263-b5343561341b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:21.764133 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-a6dcf785-6133-443b-8263-b5343561341b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.283041 Apr 08 02:46:21.764696 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 95/182] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:21 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:22.781253 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c92adc00-56b6-4d88-b54f-1f378736351f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:22.781787 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c92adc00-56b6-4d88-b54f-1f378736351f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:22.789026 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c92adc00-56b6-4d88-b54f-1f378736351f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:22.789468 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c92adc00-56b6-4d88-b54f-1f378736351f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:22.790217 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c92adc00-56b6-4d88-b54f-1f378736351f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:22.790644 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c92adc00-56b6-4d88-b54f-1f378736351f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:22.990479 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c92adc00-56b6-4d88-b54f-1f378736351f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:22.998683 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c92adc00-56b6-4d88-b54f-1f378736351f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.221692 Apr 08 02:46:22.999247 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 88/183] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:22 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:24.015207 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0f22c2a5-d7cd-49d7-9833-52919652c7af tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:24.015878 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0f22c2a5-d7cd-49d7-9833-52919652c7af tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:24.023022 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0f22c2a5-d7cd-49d7-9833-52919652c7af tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:24.023461 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0f22c2a5-d7cd-49d7-9833-52919652c7af tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:24.024247 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0f22c2a5-d7cd-49d7-9833-52919652c7af tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:24.024675 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0f22c2a5-d7cd-49d7-9833-52919652c7af tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:24.225029 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0f22c2a5-d7cd-49d7-9833-52919652c7af tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:24.233930 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0f22c2a5-d7cd-49d7-9833-52919652c7af tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.222404 Apr 08 02:46:24.234490 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 96/184] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:24 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:25.250323 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4b29b637-85e8-4d37-b56e-1318efa98e76 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:25.250963 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-4b29b637-85e8-4d37-b56e-1318efa98e76 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:25.258100 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4b29b637-85e8-4d37-b56e-1318efa98e76 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:25.258550 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4b29b637-85e8-4d37-b56e-1318efa98e76 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:25.259306 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4b29b637-85e8-4d37-b56e-1318efa98e76 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:25.259739 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4b29b637-85e8-4d37-b56e-1318efa98e76 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:25.625575 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4b29b637-85e8-4d37-b56e-1318efa98e76 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:25.635389 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4b29b637-85e8-4d37-b56e-1318efa98e76 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.388697 Apr 08 02:46:25.636318 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 89/185] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:25 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:26.652025 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5316fd22-c59f-4db5-babc-6eca6da7a0c5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:26.652643 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5316fd22-c59f-4db5-babc-6eca6da7a0c5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:26.660439 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5316fd22-c59f-4db5-babc-6eca6da7a0c5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:26.660892 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5316fd22-c59f-4db5-babc-6eca6da7a0c5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:26.661709 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5316fd22-c59f-4db5-babc-6eca6da7a0c5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:26.662146 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5316fd22-c59f-4db5-babc-6eca6da7a0c5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:26.850479 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5316fd22-c59f-4db5-babc-6eca6da7a0c5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:26.858747 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5316fd22-c59f-4db5-babc-6eca6da7a0c5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.210394 Apr 08 02:46:26.859645 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 97/186] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:26 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:27.876149 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ccb14789-0ba7-4a23-98be-51473a9e208c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:27.876763 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ccb14789-0ba7-4a23-98be-51473a9e208c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:27.884014 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ccb14789-0ba7-4a23-98be-51473a9e208c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:27.884465 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ccb14789-0ba7-4a23-98be-51473a9e208c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:27.885225 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ccb14789-0ba7-4a23-98be-51473a9e208c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:27.885655 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ccb14789-0ba7-4a23-98be-51473a9e208c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:28.079664 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ccb14789-0ba7-4a23-98be-51473a9e208c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:28.087975 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ccb14789-0ba7-4a23-98be-51473a9e208c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.216078 Apr 08 02:46:28.088533 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 90/187] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:27 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:29.104725 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-28360492-1151-4670-8355-65a0c435ceed tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:29.105337 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-28360492-1151-4670-8355-65a0c435ceed tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:29.112650 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-28360492-1151-4670-8355-65a0c435ceed tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:29.113103 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-28360492-1151-4670-8355-65a0c435ceed tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:29.113865 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-28360492-1151-4670-8355-65a0c435ceed tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:29.114307 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-28360492-1151-4670-8355-65a0c435ceed tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:29.315091 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-28360492-1151-4670-8355-65a0c435ceed tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:29.323146 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-28360492-1151-4670-8355-65a0c435ceed tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.222095 Apr 08 02:46:29.323714 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 98/188] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:29 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:30.340303 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c4ed4fb2-eb98-481f-b1ac-ae3e34615f76 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:30.341582 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c4ed4fb2-eb98-481f-b1ac-ae3e34615f76 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:30.348863 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c4ed4fb2-eb98-481f-b1ac-ae3e34615f76 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:30.349362 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c4ed4fb2-eb98-481f-b1ac-ae3e34615f76 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:30.350069 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c4ed4fb2-eb98-481f-b1ac-ae3e34615f76 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:30.350503 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c4ed4fb2-eb98-481f-b1ac-ae3e34615f76 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:30.548489 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c4ed4fb2-eb98-481f-b1ac-ae3e34615f76 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:30.556809 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c4ed4fb2-eb98-481f-b1ac-ae3e34615f76 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.220218 Apr 08 02:46:30.557359 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 91/189] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:30 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:31.575492 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d2a54214-7939-4af4-b639-2edb7b743039 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:31.576151 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d2a54214-7939-4af4-b639-2edb7b743039 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:31.584079 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d2a54214-7939-4af4-b639-2edb7b743039 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:31.584522 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d2a54214-7939-4af4-b639-2edb7b743039 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:31.585278 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d2a54214-7939-4af4-b639-2edb7b743039 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:31.585707 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d2a54214-7939-4af4-b639-2edb7b743039 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:31.794856 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d2a54214-7939-4af4-b639-2edb7b743039 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:31.803757 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d2a54214-7939-4af4-b639-2edb7b743039 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.232030 Apr 08 02:46:31.804349 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 99/190] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:31 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:32.822101 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-228b9a7e-e8c9-4129-b284-8641dec9f203 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:32.823546 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-228b9a7e-e8c9-4129-b284-8641dec9f203 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:32.833574 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-228b9a7e-e8c9-4129-b284-8641dec9f203 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:32.834046 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-228b9a7e-e8c9-4129-b284-8641dec9f203 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:32.834818 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-228b9a7e-e8c9-4129-b284-8641dec9f203 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:32.835249 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-228b9a7e-e8c9-4129-b284-8641dec9f203 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:33.045148 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-228b9a7e-e8c9-4129-b284-8641dec9f203 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:33.053655 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-228b9a7e-e8c9-4129-b284-8641dec9f203 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.236485 Apr 08 02:46:33.054211 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 92/191] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:32 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:34.070463 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-37800a42-7de9-4652-8ee7-4ae2137bdd2e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:34.071177 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-37800a42-7de9-4652-8ee7-4ae2137bdd2e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:34.079028 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-37800a42-7de9-4652-8ee7-4ae2137bdd2e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:34.079482 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-37800a42-7de9-4652-8ee7-4ae2137bdd2e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:34.080282 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-37800a42-7de9-4652-8ee7-4ae2137bdd2e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:34.080725 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-37800a42-7de9-4652-8ee7-4ae2137bdd2e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:34.281144 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-37800a42-7de9-4652-8ee7-4ae2137bdd2e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:34.289911 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-37800a42-7de9-4652-8ee7-4ae2137bdd2e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.222947 Apr 08 02:46:34.290483 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 100/192] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:34 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:35.308854 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-293178cc-9b93-4f8c-84b3-433116a1687d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:35.310121 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-293178cc-9b93-4f8c-84b3-433116a1687d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:35.317192 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-293178cc-9b93-4f8c-84b3-433116a1687d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:35.317639 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-293178cc-9b93-4f8c-84b3-433116a1687d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:35.318397 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-293178cc-9b93-4f8c-84b3-433116a1687d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:35.318831 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-293178cc-9b93-4f8c-84b3-433116a1687d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:35.514627 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-293178cc-9b93-4f8c-84b3-433116a1687d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:35.522728 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-293178cc-9b93-4f8c-84b3-433116a1687d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.217761 Apr 08 02:46:35.523275 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 93/193] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:35 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:36.539504 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-adead34c-bd63-4fb8-92fd-4136bfb3917c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:36.540142 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-adead34c-bd63-4fb8-92fd-4136bfb3917c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:36.547390 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-adead34c-bd63-4fb8-92fd-4136bfb3917c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:36.547834 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-adead34c-bd63-4fb8-92fd-4136bfb3917c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:36.548618 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-adead34c-bd63-4fb8-92fd-4136bfb3917c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:36.549046 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-adead34c-bd63-4fb8-92fd-4136bfb3917c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:36.742299 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-adead34c-bd63-4fb8-92fd-4136bfb3917c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:36.750821 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-adead34c-bd63-4fb8-92fd-4136bfb3917c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.214953 Apr 08 02:46:36.751378 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 101/194] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:36 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:37.766948 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ba99de26-30f1-4d2d-8a0a-c1955b74728d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:37.767493 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ba99de26-30f1-4d2d-8a0a-c1955b74728d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:37.774569 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ba99de26-30f1-4d2d-8a0a-c1955b74728d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:37.775009 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ba99de26-30f1-4d2d-8a0a-c1955b74728d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:37.775760 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ba99de26-30f1-4d2d-8a0a-c1955b74728d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:37.776222 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ba99de26-30f1-4d2d-8a0a-c1955b74728d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:37.973113 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ba99de26-30f1-4d2d-8a0a-c1955b74728d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:37.981534 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ba99de26-30f1-4d2d-8a0a-c1955b74728d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.217972 Apr 08 02:46:37.982095 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 94/195] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:37 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:38.998593 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3938f595-2996-4ff2-98e6-a3efe64cb482 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:38.999195 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-3938f595-2996-4ff2-98e6-a3efe64cb482 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:39.006622 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3938f595-2996-4ff2-98e6-a3efe64cb482 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:39.007075 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3938f595-2996-4ff2-98e6-a3efe64cb482 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:39.007840 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3938f595-2996-4ff2-98e6-a3efe64cb482 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:39.008296 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3938f595-2996-4ff2-98e6-a3efe64cb482 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:39.372181 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-3938f595-2996-4ff2-98e6-a3efe64cb482 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:39.382045 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3938f595-2996-4ff2-98e6-a3efe64cb482 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1521 microversion: 2.1 time: 0.387226 Apr 08 02:46:39.384347 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 102/196] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:38 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:40.401188 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-10f6de98-80f3-45e1-91c7-f41280c7c8e4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:40.401790 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-10f6de98-80f3-45e1-91c7-f41280c7c8e4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:40.409308 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-10f6de98-80f3-45e1-91c7-f41280c7c8e4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:40.409748 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-10f6de98-80f3-45e1-91c7-f41280c7c8e4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:40.410501 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-10f6de98-80f3-45e1-91c7-f41280c7c8e4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:40.410930 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-10f6de98-80f3-45e1-91c7-f41280c7c8e4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:40.636205 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-10f6de98-80f3-45e1-91c7-f41280c7c8e4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:40.645118 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-10f6de98-80f3-45e1-91c7-f41280c7c8e4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1501 microversion: 2.1 time: 0.247578 Apr 08 02:46:40.646105 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 95/197] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:40 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1501 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:40.662971 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-001fd001-a2f6-4851-8cfe-95c79ef15574 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:40.663668 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-001fd001-a2f6-4851-8cfe-95c79ef15574 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:40.671326 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-001fd001-a2f6-4851-8cfe-95c79ef15574 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:40.671847 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-001fd001-a2f6-4851-8cfe-95c79ef15574 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:40.672746 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-001fd001-a2f6-4851-8cfe-95c79ef15574 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:40.673357 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-001fd001-a2f6-4851-8cfe-95c79ef15574 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:40.876585 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-001fd001-a2f6-4851-8cfe-95c79ef15574 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:40.884858 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-001fd001-a2f6-4851-8cfe-95c79ef15574 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1516 microversion: 2.1 time: 0.227175 Apr 08 02:46:40.885496 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 103/198] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:40 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1516 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:46.732552 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f8bfd131-9512-423a-9053-876bc63d9348 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:46:46.733497 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f8bfd131-9512-423a-9053-876bc63d9348 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:46.740957 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f8bfd131-9512-423a-9053-876bc63d9348 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:46.741399 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f8bfd131-9512-423a-9053-876bc63d9348 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:46.742150 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f8bfd131-9512-423a-9053-876bc63d9348 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:46.742576 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f8bfd131-9512-423a-9053-876bc63d9348 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:46.804181 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.objects.instance [None req-f8bfd131-9512-423a-9053-876bc63d9348 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lazy-loading 'flavor' on Instance uuid 96569291-3f37-4b65-b902-9e31040c4328 {{(pid=101271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:46:46.949252 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f8bfd131-9512-423a-9053-876bc63d9348 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "POST /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328/action" status: 200 len: 32 microversion: 2.1 time: 0.220978 Apr 08 02:46:46.949764 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 96/199] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Apr 8 02:46:46 2022] POST /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328/action => generated 32 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:46:46.963371 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9fdf920a-6c4d-4409-bbab-eb149dfdc626 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:46.963371 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9fdf920a-6c4d-4409-bbab-eb149dfdc626 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:46.968600 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9fdf920a-6c4d-4409-bbab-eb149dfdc626 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:46.969150 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9fdf920a-6c4d-4409-bbab-eb149dfdc626 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:46.970058 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9fdf920a-6c4d-4409-bbab-eb149dfdc626 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:46.970552 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9fdf920a-6c4d-4409-bbab-eb149dfdc626 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:47.325929 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9fdf920a-6c4d-4409-bbab-eb149dfdc626 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:47.336801 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9fdf920a-6c4d-4409-bbab-eb149dfdc626 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1522 microversion: 2.1 time: 0.381173 Apr 08 02:46:47.337370 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 104/200] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:46 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:48.354979 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-064f71e7-3547-4d46-9c62-8530fd905905 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:48.355693 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-064f71e7-3547-4d46-9c62-8530fd905905 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:48.363641 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-064f71e7-3547-4d46-9c62-8530fd905905 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:48.364123 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-064f71e7-3547-4d46-9c62-8530fd905905 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:48.364879 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-064f71e7-3547-4d46-9c62-8530fd905905 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:48.365307 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-064f71e7-3547-4d46-9c62-8530fd905905 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:48.577090 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-064f71e7-3547-4d46-9c62-8530fd905905 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:48.585191 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-064f71e7-3547-4d46-9c62-8530fd905905 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1522 microversion: 2.1 time: 0.234365 Apr 08 02:46:48.585746 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 97/201] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:48 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:49.603401 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-090f8923-3ef6-4e54-b5c8-c2269ad570ee tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:49.604244 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-090f8923-3ef6-4e54-b5c8-c2269ad570ee tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:49.615126 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-090f8923-3ef6-4e54-b5c8-c2269ad570ee tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:49.615499 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-090f8923-3ef6-4e54-b5c8-c2269ad570ee tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:49.616483 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-090f8923-3ef6-4e54-b5c8-c2269ad570ee tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:49.616913 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-090f8923-3ef6-4e54-b5c8-c2269ad570ee tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:49.838287 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-090f8923-3ef6-4e54-b5c8-c2269ad570ee tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:49.847177 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-090f8923-3ef6-4e54-b5c8-c2269ad570ee tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1522 microversion: 2.1 time: 0.249189 Apr 08 02:46:49.847734 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 105/202] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:49 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:50.869445 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c6db4714-1883-40e9-bf85-d2fee4dd5921 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:50.871533 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c6db4714-1883-40e9-bf85-d2fee4dd5921 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:50.885342 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c6db4714-1883-40e9-bf85-d2fee4dd5921 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:50.886066 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c6db4714-1883-40e9-bf85-d2fee4dd5921 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:50.887989 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c6db4714-1883-40e9-bf85-d2fee4dd5921 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:50.889134 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c6db4714-1883-40e9-bf85-d2fee4dd5921 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:51.154414 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c6db4714-1883-40e9-bf85-d2fee4dd5921 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:51.163417 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c6db4714-1883-40e9-bf85-d2fee4dd5921 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1522 microversion: 2.1 time: 0.302166 Apr 08 02:46:51.164896 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 98/203] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:50 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:52.181473 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b56aa78e-cdca-457d-8e15-80748fe31135 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:52.182086 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b56aa78e-cdca-457d-8e15-80748fe31135 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:52.193975 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b56aa78e-cdca-457d-8e15-80748fe31135 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:52.195968 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b56aa78e-cdca-457d-8e15-80748fe31135 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:52.196485 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b56aa78e-cdca-457d-8e15-80748fe31135 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:52.196933 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b56aa78e-cdca-457d-8e15-80748fe31135 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:52.410922 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b56aa78e-cdca-457d-8e15-80748fe31135 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:52.420459 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b56aa78e-cdca-457d-8e15-80748fe31135 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1522 microversion: 2.1 time: 0.242554 Apr 08 02:46:52.421027 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 106/204] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:52 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:53.421118 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-eb2abdd6-8529-40f3-92dd-b75d2d46fa3f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1630407048", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452", "networks": [{"uuid": "82e858b5-a7a6-4321-935a-f5708e9fb4a1"}]}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:46:53.438565 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f02683e0-1eb4-4cdf-89de-5aea0fc725c0 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:53.440081 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f02683e0-1eb4-4cdf-89de-5aea0fc725c0 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:53.448998 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f02683e0-1eb4-4cdf-89de-5aea0fc725c0 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:53.449780 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f02683e0-1eb4-4cdf-89de-5aea0fc725c0 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:53.451463 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f02683e0-1eb4-4cdf-89de-5aea0fc725c0 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:53.452108 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f02683e0-1eb4-4cdf-89de-5aea0fc725c0 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:53.502552 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.network.neutron [None req-eb2abdd6-8529-40f3-92dd-b75d2d46fa3f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] validate_networks() for [('82e858b5-a7a6-4321-935a-f5708e9fb4a1', None, None, None)] {{(pid=101271) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:46:53.673704 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f02683e0-1eb4-4cdf-89de-5aea0fc725c0 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:53.683048 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f02683e0-1eb4-4cdf-89de-5aea0fc725c0 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1522 microversion: 2.1 time: 0.249668 Apr 08 02:46:53.683745 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 107/205] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:53 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:54.034478 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-eb2abdd6-8529-40f3-92dd-b75d2d46fa3f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Flavor limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:46:54.034972 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-eb2abdd6-8529-40f3-92dd-b75d2d46fa3f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Image limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:46:54.035453 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-eb2abdd6-8529-40f3-92dd-b75d2d46fa3f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Flavor pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:46:54.035864 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-eb2abdd6-8529-40f3-92dd-b75d2d46fa3f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Image pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:46:54.036296 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-eb2abdd6-8529-40f3-92dd-b75d2d46fa3f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:46:54.045902 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-eb2abdd6-8529-40f3-92dd-b75d2d46fa3f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:54.046744 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-eb2abdd6-8529-40f3-92dd-b75d2d46fa3f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:54.047873 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-eb2abdd6-8529-40f3-92dd-b75d2d46fa3f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:54.048671 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-eb2abdd6-8529-40f3-92dd-b75d2d46fa3f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:54.068682 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-eb2abdd6-8529-40f3-92dd-b75d2d46fa3f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Getting quotas for project f648ffbed31f4192b6f16124451b3559. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:46:54.072910 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-eb2abdd6-8529-40f3-92dd-b75d2d46fa3f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Getting quotas for user bf2c93aa211c4587a97533f4b4e50b11 and project f648ffbed31f4192b6f16124451b3559. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:46:54.085594 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-eb2abdd6-8529-40f3-92dd-b75d2d46fa3f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Going to run 1 instances... {{(pid=101271) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:46:54.087955 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-eb2abdd6-8529-40f3-92dd-b75d2d46fa3f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:46:54.135586 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-eb2abdd6-8529-40f3-92dd-b75d2d46fa3f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718206 Apr 08 02:46:54.136942 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 99/206] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:46:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:46:54.149743 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-36ec6a6c-ee9d-4d3d-9398-d5e199dc7645 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:54.150421 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-36ec6a6c-ee9d-4d3d-9398-d5e199dc7645 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:54.244849 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-36ec6a6c-ee9d-4d3d-9398-d5e199dc7645 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:54.253661 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-36ec6a6c-ee9d-4d3d-9398-d5e199dc7645 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1219 microversion: 2.1 time: 0.110389 Apr 08 02:46:54.254526 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 108/207] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:54 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:54.701487 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-44b45913-c887-4663-b154-9950322702a7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:54.702260 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-44b45913-c887-4663-b154-9950322702a7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:54.711050 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-44b45913-c887-4663-b154-9950322702a7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:54.711520 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-44b45913-c887-4663-b154-9950322702a7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:54.712394 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-44b45913-c887-4663-b154-9950322702a7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:54.712889 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-44b45913-c887-4663-b154-9950322702a7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:54.917151 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-44b45913-c887-4663-b154-9950322702a7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:54.925838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-44b45913-c887-4663-b154-9950322702a7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1522 microversion: 2.1 time: 0.229725 Apr 08 02:46:54.926388 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 100/208] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:54 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:55.270601 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e5b83ad0-41a9-43da-b065-35efa41a68f9 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:55.271207 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e5b83ad0-41a9-43da-b065-35efa41a68f9 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:55.279020 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e5b83ad0-41a9-43da-b065-35efa41a68f9 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:55.279516 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e5b83ad0-41a9-43da-b065-35efa41a68f9 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:55.280300 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e5b83ad0-41a9-43da-b065-35efa41a68f9 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:55.280731 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e5b83ad0-41a9-43da-b065-35efa41a68f9 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:55.398417 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e5b83ad0-41a9-43da-b065-35efa41a68f9 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:55.407129 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e5b83ad0-41a9-43da-b065-35efa41a68f9 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1271 microversion: 2.1 time: 0.140247 Apr 08 02:46:55.407887 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 109/209] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:55 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1271 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:55.942572 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-59084691-7d79-4f3b-b412-10908caf0c86 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:55.943177 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-59084691-7d79-4f3b-b412-10908caf0c86 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:55.951421 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-59084691-7d79-4f3b-b412-10908caf0c86 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:55.952310 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-59084691-7d79-4f3b-b412-10908caf0c86 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:55.953247 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-59084691-7d79-4f3b-b412-10908caf0c86 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:55.953837 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-59084691-7d79-4f3b-b412-10908caf0c86 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:56.161287 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-59084691-7d79-4f3b-b412-10908caf0c86 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:56.171968 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-59084691-7d79-4f3b-b412-10908caf0c86 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1522 microversion: 2.1 time: 0.232786 Apr 08 02:46:56.172462 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 101/210] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:55 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:56.424979 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-577c0174-3eae-460c-a03f-93eba91fabba tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:56.425502 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-577c0174-3eae-460c-a03f-93eba91fabba tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:56.432834 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-577c0174-3eae-460c-a03f-93eba91fabba tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:56.433274 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-577c0174-3eae-460c-a03f-93eba91fabba tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:56.434037 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-577c0174-3eae-460c-a03f-93eba91fabba tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:56.435004 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-577c0174-3eae-460c-a03f-93eba91fabba tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:56.927625 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-577c0174-3eae-460c-a03f-93eba91fabba tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:56.936923 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-577c0174-3eae-460c-a03f-93eba91fabba tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1319 microversion: 2.1 time: 0.515589 Apr 08 02:46:56.937517 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 110/211] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:56 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:57.188948 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-9cfa1163-a8fc-4c5e-b31b-c0963d7896ef tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:57.190297 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-9cfa1163-a8fc-4c5e-b31b-c0963d7896ef tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:57.197536 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9cfa1163-a8fc-4c5e-b31b-c0963d7896ef tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:57.198161 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9cfa1163-a8fc-4c5e-b31b-c0963d7896ef tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:57.199123 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9cfa1163-a8fc-4c5e-b31b-c0963d7896ef tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:57.199563 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9cfa1163-a8fc-4c5e-b31b-c0963d7896ef tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:57.416808 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-9cfa1163-a8fc-4c5e-b31b-c0963d7896ef tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:57.425668 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-9cfa1163-a8fc-4c5e-b31b-c0963d7896ef tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1522 microversion: 2.1 time: 0.240497 Apr 08 02:46:57.426224 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 102/212] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:57 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:57.798437 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-7edc00f7-c934-44c4-bc2a-2e400a10230f req-c9ec56a1-748d-4a71-9535-739fe8915c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe", "tag": "14d1b36d-6c01-4e8d-a401-29ca0ecd841c"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:46:57.800094 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:46:57.800094 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:46:57.810249 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-7edc00f7-c934-44c4-bc2a-2e400a10230f req-c9ec56a1-748d-4a71-9535-739fe8915c3e service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:57.810704 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-7edc00f7-c934-44c4-bc2a-2e400a10230f req-c9ec56a1-748d-4a71-9535-739fe8915c3e service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:57.827600 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-7edc00f7-c934-44c4-bc2a-2e400a10230f req-c9ec56a1-748d-4a71-9535-739fe8915c3e service nova] Creating event network-changed:14d1b36d-6c01-4e8d-a401-29ca0ecd841c for instance 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe on hv-cinder-83705 Apr 08 02:46:57.835693 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-7edc00f7-c934-44c4-bc2a-2e400a10230f req-c9ec56a1-748d-4a71-9535-739fe8915c3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040761 Apr 08 02:46:57.836340 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 111/213] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:46:57.953708 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-218044cf-96e2-4fa6-bb01-bd1d1f9739ed tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:57.954887 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-218044cf-96e2-4fa6-bb01-bd1d1f9739ed tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:57.965549 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-218044cf-96e2-4fa6-bb01-bd1d1f9739ed tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:57.966202 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-218044cf-96e2-4fa6-bb01-bd1d1f9739ed tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:57.967026 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-218044cf-96e2-4fa6-bb01-bd1d1f9739ed tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:57.967457 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-218044cf-96e2-4fa6-bb01-bd1d1f9739ed tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:58.167616 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-218044cf-96e2-4fa6-bb01-bd1d1f9739ed tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:58.177491 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-218044cf-96e2-4fa6-bb01-bd1d1f9739ed tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1319 microversion: 2.1 time: 0.227550 Apr 08 02:46:58.178592 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 103/214] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:57 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:58.444268 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d0ab94da-937b-4ea5-9221-316afe1c336e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:58.446105 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d0ab94da-937b-4ea5-9221-316afe1c336e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:58.456758 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d0ab94da-937b-4ea5-9221-316afe1c336e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:58.457431 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d0ab94da-937b-4ea5-9221-316afe1c336e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:58.458456 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d0ab94da-937b-4ea5-9221-316afe1c336e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:58.459271 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d0ab94da-937b-4ea5-9221-316afe1c336e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:58.913324 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d0ab94da-937b-4ea5-9221-316afe1c336e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:58.921756 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d0ab94da-937b-4ea5-9221-316afe1c336e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1522 microversion: 2.1 time: 0.482862 Apr 08 02:46:58.922326 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 112/215] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:58 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:59.195559 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-3c4cb88b-1f3b-4b99-b1c3-dee41b0e1063 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:59.197199 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-3c4cb88b-1f3b-4b99-b1c3-dee41b0e1063 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:59.205613 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3c4cb88b-1f3b-4b99-b1c3-dee41b0e1063 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:59.206376 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3c4cb88b-1f3b-4b99-b1c3-dee41b0e1063 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:59.207377 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3c4cb88b-1f3b-4b99-b1c3-dee41b0e1063 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:59.207996 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3c4cb88b-1f3b-4b99-b1c3-dee41b0e1063 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:59.471416 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3c4cb88b-1f3b-4b99-b1c3-dee41b0e1063 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:46:59.481060 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-3c4cb88b-1f3b-4b99-b1c3-dee41b0e1063 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1319 microversion: 2.1 time: 0.288929 Apr 08 02:46:59.482777 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 104/216] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:59 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:59.939350 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9a5a8767-64de-4dcc-abda-7d0bf5dc7a94 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:59.940009 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9a5a8767-64de-4dcc-abda-7d0bf5dc7a94 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:46:59.948113 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9a5a8767-64de-4dcc-abda-7d0bf5dc7a94 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:59.948679 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9a5a8767-64de-4dcc-abda-7d0bf5dc7a94 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:59.952635 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9a5a8767-64de-4dcc-abda-7d0bf5dc7a94 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:59.956761 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9a5a8767-64de-4dcc-abda-7d0bf5dc7a94 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:00.165530 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9a5a8767-64de-4dcc-abda-7d0bf5dc7a94 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:00.174840 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9a5a8767-64de-4dcc-abda-7d0bf5dc7a94 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1522 microversion: 2.1 time: 0.239448 Apr 08 02:47:00.175603 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 113/217] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:59 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:00.499832 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2a2da791-3d68-4d43-9b68-88ceb0dc1150 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:00.501144 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2a2da791-3d68-4d43-9b68-88ceb0dc1150 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:00.509623 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2a2da791-3d68-4d43-9b68-88ceb0dc1150 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:00.510304 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2a2da791-3d68-4d43-9b68-88ceb0dc1150 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:00.511474 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2a2da791-3d68-4d43-9b68-88ceb0dc1150 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:00.511916 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2a2da791-3d68-4d43-9b68-88ceb0dc1150 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:00.714992 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2a2da791-3d68-4d43-9b68-88ceb0dc1150 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:00.727218 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2a2da791-3d68-4d43-9b68-88ceb0dc1150 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1319 microversion: 2.1 time: 0.232444 Apr 08 02:47:00.727878 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 105/218] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:00 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:01.192179 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5de23016-27b3-4287-9fd5-217718268801 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:01.193154 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5de23016-27b3-4287-9fd5-217718268801 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:01.202422 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5de23016-27b3-4287-9fd5-217718268801 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:01.202937 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5de23016-27b3-4287-9fd5-217718268801 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:01.203841 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5de23016-27b3-4287-9fd5-217718268801 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:01.204335 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5de23016-27b3-4287-9fd5-217718268801 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:01.414449 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5de23016-27b3-4287-9fd5-217718268801 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:01.423182 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5de23016-27b3-4287-9fd5-217718268801 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1522 microversion: 2.1 time: 0.234806 Apr 08 02:47:01.423772 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 114/219] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:01 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:01.743799 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c7375299-76ca-4180-84f6-22661d6a44c6 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:01.744451 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c7375299-76ca-4180-84f6-22661d6a44c6 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:01.751676 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c7375299-76ca-4180-84f6-22661d6a44c6 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:01.752180 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c7375299-76ca-4180-84f6-22661d6a44c6 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:01.752952 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c7375299-76ca-4180-84f6-22661d6a44c6 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:01.753393 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c7375299-76ca-4180-84f6-22661d6a44c6 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:02.039207 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c7375299-76ca-4180-84f6-22661d6a44c6 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:02.047649 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c7375299-76ca-4180-84f6-22661d6a44c6 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1319 microversion: 2.1 time: 0.307565 Apr 08 02:47:02.048438 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 106/220] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:01 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:02.440698 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-aacd5872-5ce3-43a6-bb51-488eccd8e427 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:02.441389 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-aacd5872-5ce3-43a6-bb51-488eccd8e427 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:02.448815 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aacd5872-5ce3-43a6-bb51-488eccd8e427 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:02.449345 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aacd5872-5ce3-43a6-bb51-488eccd8e427 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:02.450896 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aacd5872-5ce3-43a6-bb51-488eccd8e427 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:02.451483 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aacd5872-5ce3-43a6-bb51-488eccd8e427 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:02.658264 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-aacd5872-5ce3-43a6-bb51-488eccd8e427 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:02.666992 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-aacd5872-5ce3-43a6-bb51-488eccd8e427 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1522 microversion: 2.1 time: 0.230078 Apr 08 02:47:02.667685 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 115/221] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:02 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:03.065370 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-17ff8bc0-22b3-44a3-9b0b-277a6d05c715 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:03.065733 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-17ff8bc0-22b3-44a3-9b0b-277a6d05c715 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:03.072856 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-17ff8bc0-22b3-44a3-9b0b-277a6d05c715 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:03.073306 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-17ff8bc0-22b3-44a3-9b0b-277a6d05c715 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:03.074067 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-17ff8bc0-22b3-44a3-9b0b-277a6d05c715 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:03.074499 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-17ff8bc0-22b3-44a3-9b0b-277a6d05c715 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:03.279080 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-17ff8bc0-22b3-44a3-9b0b-277a6d05c715 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:03.287199 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-17ff8bc0-22b3-44a3-9b0b-277a6d05c715 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1319 microversion: 2.1 time: 0.225791 Apr 08 02:47:03.287796 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 107/222] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:03 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:03.695446 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ac2ae165-f77e-4a1c-a364-ea8f510b52aa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:03.696095 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ac2ae165-f77e-4a1c-a364-ea8f510b52aa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:03.704806 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ac2ae165-f77e-4a1c-a364-ea8f510b52aa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:03.705255 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ac2ae165-f77e-4a1c-a364-ea8f510b52aa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:03.706046 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ac2ae165-f77e-4a1c-a364-ea8f510b52aa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:03.706484 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ac2ae165-f77e-4a1c-a364-ea8f510b52aa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:03.902279 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ac2ae165-f77e-4a1c-a364-ea8f510b52aa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:03.911040 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ac2ae165-f77e-4a1c-a364-ea8f510b52aa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1502 microversion: 2.1 time: 0.219343 Apr 08 02:47:03.911609 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 116/223] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:03 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1502 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:03.928278 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ec71c3b2-3638-4fda-8e07-bfdad9fd40c1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58d0d783-b065-4778-8553-9e556efbdeeb"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:03.929399 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ec71c3b2-3638-4fda-8e07-bfdad9fd40c1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:03.936776 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ec71c3b2-3638-4fda-8e07-bfdad9fd40c1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:03.937220 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ec71c3b2-3638-4fda-8e07-bfdad9fd40c1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:03.937989 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ec71c3b2-3638-4fda-8e07-bfdad9fd40c1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:03.938422 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ec71c3b2-3638-4fda-8e07-bfdad9fd40c1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:03.997473 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-ec71c3b2-3638-4fda-8e07-bfdad9fd40c1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] HTTP exception thrown: Cannot 'attach_volume' instance 96569291-3f37-4b65-b902-9e31040c4328 while it is in vm_state rescued Apr 08 02:47:03.998064 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ec71c3b2-3638-4fda-8e07-bfdad9fd40c1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Returning 409 to user: Cannot 'attach_volume' instance 96569291-3f37-4b65-b902-9e31040c4328 while it is in vm_state rescued {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:47:03.998879 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ec71c3b2-3638-4fda-8e07-bfdad9fd40c1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "POST /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074768 Apr 08 02:47:03.999441 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 108/224] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Apr 8 02:47:03 2022] POST /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 08 02:47:04.007578 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f3e7e190-eff7-4ef0-8fbe-21e24783c396 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:04.008140 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f3e7e190-eff7-4ef0-8fbe-21e24783c396 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:04.016142 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f3e7e190-eff7-4ef0-8fbe-21e24783c396 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:04.016626 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f3e7e190-eff7-4ef0-8fbe-21e24783c396 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:04.017450 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f3e7e190-eff7-4ef0-8fbe-21e24783c396 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:04.017890 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f3e7e190-eff7-4ef0-8fbe-21e24783c396 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:04.154640 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f3e7e190-eff7-4ef0-8fbe-21e24783c396 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "POST /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328/action" status: 202 len: 0 microversion: 2.1 time: 0.150100 Apr 08 02:47:04.155419 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 117/225] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Apr 8 02:47:04 2022] POST /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:47:04.163574 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-7ceae848-58a2-4ee3-b61b-6f0793252e67 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:04.165103 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-7ceae848-58a2-4ee3-b61b-6f0793252e67 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:04.177072 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7ceae848-58a2-4ee3-b61b-6f0793252e67 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:04.178244 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7ceae848-58a2-4ee3-b61b-6f0793252e67 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:04.179535 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7ceae848-58a2-4ee3-b61b-6f0793252e67 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:04.180172 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7ceae848-58a2-4ee3-b61b-6f0793252e67 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:04.305526 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-05eae4b1-7edf-4bf6-98d4-7efa349dc919 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:04.306632 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-05eae4b1-7edf-4bf6-98d4-7efa349dc919 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:04.314878 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-05eae4b1-7edf-4bf6-98d4-7efa349dc919 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:04.315501 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-05eae4b1-7edf-4bf6-98d4-7efa349dc919 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:04.316311 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-05eae4b1-7edf-4bf6-98d4-7efa349dc919 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:04.316749 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-05eae4b1-7edf-4bf6-98d4-7efa349dc919 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:04.398593 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-7ceae848-58a2-4ee3-b61b-6f0793252e67 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:04.407597 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-7ceae848-58a2-4ee3-b61b-6f0793252e67 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1510 microversion: 2.1 time: 0.247857 Apr 08 02:47:04.408179 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 109/226] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:04 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:04.695572 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-05eae4b1-7edf-4bf6-98d4-7efa349dc919 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:04.704556 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-05eae4b1-7edf-4bf6-98d4-7efa349dc919 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1319 microversion: 2.1 time: 0.404475 Apr 08 02:47:04.705119 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 118/227] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:04 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:47:05.425574 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ce1557f7-380d-4a34-b598-0df80e44cb68 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:05.426465 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ce1557f7-380d-4a34-b598-0df80e44cb68 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:05.435546 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ce1557f7-380d-4a34-b598-0df80e44cb68 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:05.436023 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ce1557f7-380d-4a34-b598-0df80e44cb68 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:05.436794 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ce1557f7-380d-4a34-b598-0df80e44cb68 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:05.437227 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ce1557f7-380d-4a34-b598-0df80e44cb68 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:05.644471 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ce1557f7-380d-4a34-b598-0df80e44cb68 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:05.652480 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ce1557f7-380d-4a34-b598-0df80e44cb68 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1510 microversion: 2.1 time: 0.230674 Apr 08 02:47:05.653609 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 110/228] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:05 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:05.721073 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d6ea69c7-0002-459a-b721-8b1dbf141d8d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:05.721695 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d6ea69c7-0002-459a-b721-8b1dbf141d8d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:05.729072 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d6ea69c7-0002-459a-b721-8b1dbf141d8d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:05.729518 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d6ea69c7-0002-459a-b721-8b1dbf141d8d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:05.730268 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d6ea69c7-0002-459a-b721-8b1dbf141d8d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:05.730698 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d6ea69c7-0002-459a-b721-8b1dbf141d8d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:05.927750 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d6ea69c7-0002-459a-b721-8b1dbf141d8d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:05.936735 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d6ea69c7-0002-459a-b721-8b1dbf141d8d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1319 microversion: 2.1 time: 0.219319 Apr 08 02:47:05.937308 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 119/229] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:05 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:06.669700 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-06c25ca0-d56d-4d26-af58-1ada89a799be tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:06.670493 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-06c25ca0-d56d-4d26-af58-1ada89a799be tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:06.677869 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-06c25ca0-d56d-4d26-af58-1ada89a799be tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:06.678677 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-06c25ca0-d56d-4d26-af58-1ada89a799be tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:06.679440 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-06c25ca0-d56d-4d26-af58-1ada89a799be tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:06.679867 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-06c25ca0-d56d-4d26-af58-1ada89a799be tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:06.878772 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-06c25ca0-d56d-4d26-af58-1ada89a799be tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:06.887218 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-06c25ca0-d56d-4d26-af58-1ada89a799be tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1510 microversion: 2.1 time: 0.221209 Apr 08 02:47:06.888613 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 111/230] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:06 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1510 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:06.954091 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3007b189-d52d-4296-bde6-2176c7189801 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:06.954723 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-3007b189-d52d-4296-bde6-2176c7189801 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:06.961957 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3007b189-d52d-4296-bde6-2176c7189801 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:06.962402 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3007b189-d52d-4296-bde6-2176c7189801 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:06.963161 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3007b189-d52d-4296-bde6-2176c7189801 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:06.963584 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3007b189-d52d-4296-bde6-2176c7189801 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:07.177002 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-3007b189-d52d-4296-bde6-2176c7189801 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:07.185792 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3007b189-d52d-4296-bde6-2176c7189801 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1319 microversion: 2.1 time: 0.236392 Apr 08 02:47:07.186355 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 120/231] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:06 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:07.598170 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-299d37d6-8625-4049-a4cb-6c5f78d588fd req-e39e875c-b6ff-4b59-ac2e-0594774ec30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe", "name": "network-vif-plugged", "status": "completed", "tag": "14d1b36d-6c01-4e8d-a401-29ca0ecd841c"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:07.599976 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:47:07.599976 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:47:07.610059 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-299d37d6-8625-4049-a4cb-6c5f78d588fd req-e39e875c-b6ff-4b59-ac2e-0594774ec30f service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:07.610572 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-299d37d6-8625-4049-a4cb-6c5f78d588fd req-e39e875c-b6ff-4b59-ac2e-0594774ec30f service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:07.629899 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-299d37d6-8625-4049-a4cb-6c5f78d588fd req-e39e875c-b6ff-4b59-ac2e-0594774ec30f service nova] Creating event network-vif-plugged:14d1b36d-6c01-4e8d-a401-29ca0ecd841c for instance 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe on hv-cinder-83705 Apr 08 02:47:07.635038 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-299d37d6-8625-4049-a4cb-6c5f78d588fd req-e39e875c-b6ff-4b59-ac2e-0594774ec30f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040921 Apr 08 02:47:07.635996 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 112/232] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:47:07.906391 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-6a8ad5e5-0fa4-495d-9e52-90441781abdc tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:07.906912 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-6a8ad5e5-0fa4-495d-9e52-90441781abdc tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:07.915122 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6a8ad5e5-0fa4-495d-9e52-90441781abdc tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:07.915567 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6a8ad5e5-0fa4-495d-9e52-90441781abdc tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:07.916362 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6a8ad5e5-0fa4-495d-9e52-90441781abdc tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:07.916795 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6a8ad5e5-0fa4-495d-9e52-90441781abdc tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:08.200832 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-6a8ad5e5-0fa4-495d-9e52-90441781abdc tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:08.203581 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-afdf4ea1-4b24-4fff-aed6-cdddb3c7c0e9 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:08.204824 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-afdf4ea1-4b24-4fff-aed6-cdddb3c7c0e9 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:08.209901 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-6a8ad5e5-0fa4-495d-9e52-90441781abdc tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1510 microversion: 2.1 time: 0.308072 Apr 08 02:47:08.210471 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 121/233] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:07 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1510 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:08.212926 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-afdf4ea1-4b24-4fff-aed6-cdddb3c7c0e9 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:08.213377 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-afdf4ea1-4b24-4fff-aed6-cdddb3c7c0e9 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:08.214153 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-afdf4ea1-4b24-4fff-aed6-cdddb3c7c0e9 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:08.214767 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-afdf4ea1-4b24-4fff-aed6-cdddb3c7c0e9 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:08.429433 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-afdf4ea1-4b24-4fff-aed6-cdddb3c7c0e9 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:08.438153 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-afdf4ea1-4b24-4fff-aed6-cdddb3c7c0e9 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1319 microversion: 2.1 time: 0.239481 Apr 08 02:47:08.440704 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 113/234] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:08 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:47:09.227324 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-910ec9ca-306a-4c6d-8945-89e066888646 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:09.227856 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-910ec9ca-306a-4c6d-8945-89e066888646 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:09.235598 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-910ec9ca-306a-4c6d-8945-89e066888646 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:09.236076 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-910ec9ca-306a-4c6d-8945-89e066888646 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:09.236838 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-910ec9ca-306a-4c6d-8945-89e066888646 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:09.237263 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-910ec9ca-306a-4c6d-8945-89e066888646 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:09.441325 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-910ec9ca-306a-4c6d-8945-89e066888646 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:09.449555 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-910ec9ca-306a-4c6d-8945-89e066888646 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1516 microversion: 2.1 time: 0.225935 Apr 08 02:47:09.450929 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 122/235] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:09 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1516 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:09.458743 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a5c0ffcd-c666-497c-b7e2-f966c2ba6bf5 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:09.460042 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a5c0ffcd-c666-497c-b7e2-f966c2ba6bf5 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:09.478222 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a5c0ffcd-c666-497c-b7e2-f966c2ba6bf5 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:09.478714 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a5c0ffcd-c666-497c-b7e2-f966c2ba6bf5 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:09.479958 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a5c0ffcd-c666-497c-b7e2-f966c2ba6bf5 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:09.480500 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a5c0ffcd-c666-497c-b7e2-f966c2ba6bf5 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:09.756458 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a5c0ffcd-c666-497c-b7e2-f966c2ba6bf5 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:09.766020 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a5c0ffcd-c666-497c-b7e2-f966c2ba6bf5 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1319 microversion: 2.1 time: 0.312804 Apr 08 02:47:09.766432 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 114/236] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:09 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:10.782443 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-87ac0af8-e149-4ca4-baa3-22e78f35df7c tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:10.783240 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-87ac0af8-e149-4ca4-baa3-22e78f35df7c tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:10.790573 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-87ac0af8-e149-4ca4-baa3-22e78f35df7c tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:10.791018 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-87ac0af8-e149-4ca4-baa3-22e78f35df7c tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:10.791777 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-87ac0af8-e149-4ca4-baa3-22e78f35df7c tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:10.792232 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-87ac0af8-e149-4ca4-baa3-22e78f35df7c tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:10.999079 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-87ac0af8-e149-4ca4-baa3-22e78f35df7c tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:11.008613 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-87ac0af8-e149-4ca4-baa3-22e78f35df7c tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1509 microversion: 2.1 time: 0.229790 Apr 08 02:47:11.009194 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 123/237] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:10 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:12.093278 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-bb814234-2ee1-4d8b-ac29-ae4ff26d5e79 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Action: 'create', calling method: .version_select at 0x7fbc386f55e0>, body: {"keypair": {"name": "tempest-keypair-429806259"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:12.114826 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-bb814234-2ee1-4d8b-ac29-ae4ff26d5e79 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Getting quotas for project bd1b3bd04ce44cd7893a53eb18d9a8b0. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:47:12.118640 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-bb814234-2ee1-4d8b-ac29-ae4ff26d5e79 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Getting quotas for user b3cc30404a3c4a16aff55c90e698e489 and project bd1b3bd04ce44cd7893a53eb18d9a8b0. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:47:12.479887 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-bb814234-2ee1-4d8b-ac29-ae4ff26d5e79 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Getting quotas for project bd1b3bd04ce44cd7893a53eb18d9a8b0. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:47:12.485013 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-bb814234-2ee1-4d8b-ac29-ae4ff26d5e79 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Getting quotas for user b3cc30404a3c4a16aff55c90e698e489 and project bd1b3bd04ce44cd7893a53eb18d9a8b0. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:47:12.498876 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-bb814234-2ee1-4d8b-ac29-ae4ff26d5e79 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.409796 Apr 08 02:47:12.499474 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 115/238] 10.222.0.23 () {60 vars in 1157 bytes} [Fri Apr 8 02:47:12 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:14.282552 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1f56f3bd-2686-428a-b464-ae36b68f7094 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1881980719", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94ddd372-ab57-40b5-ae02-402f4da20997"}], "security_groups": [{"name": "tempest-securitygroup--1278533987"}], "key_name": "tempest-keypair-429806259", "user_data": "}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:24.562212 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 02:47:24.562892 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: Fri Apr 8 02:47:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Apr 08 02:47:26.758115 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.network.neutron [None req-1f56f3bd-2686-428a-b464-ae36b68f7094 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] validate_networks() for [('94ddd372-ab57-40b5-ae02-402f4da20997', None, None, None)] {{(pid=101272) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:47:27.270732 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-1f56f3bd-2686-428a-b464-ae36b68f7094 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Flavor limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:47:27.271182 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-1f56f3bd-2686-428a-b464-ae36b68f7094 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Image limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:47:27.271650 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-1f56f3bd-2686-428a-b464-ae36b68f7094 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Flavor pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:47:27.272084 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-1f56f3bd-2686-428a-b464-ae36b68f7094 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Image pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:47:27.272494 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-1f56f3bd-2686-428a-b464-ae36b68f7094 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:47:27.280612 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1f56f3bd-2686-428a-b464-ae36b68f7094 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:27.281052 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1f56f3bd-2686-428a-b464-ae36b68f7094 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:27.281840 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1f56f3bd-2686-428a-b464-ae36b68f7094 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:27.282263 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1f56f3bd-2686-428a-b464-ae36b68f7094 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:27.299645 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-1f56f3bd-2686-428a-b464-ae36b68f7094 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Getting quotas for project bd1b3bd04ce44cd7893a53eb18d9a8b0. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:47:27.303766 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-1f56f3bd-2686-428a-b464-ae36b68f7094 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Getting quotas for user b3cc30404a3c4a16aff55c90e698e489 and project bd1b3bd04ce44cd7893a53eb18d9a8b0. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:47:27.313970 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1f56f3bd-2686-428a-b464-ae36b68f7094 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Going to run 1 instances... {{(pid=101272) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:47:27.316633 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1f56f3bd-2686-428a-b464-ae36b68f7094 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:47:27.363846 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1f56f3bd-2686-428a-b464-ae36b68f7094 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 13.085923 Apr 08 02:47:27.364508 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 124/239] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:47:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 13087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:47:27.374176 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-11dff386-a219-4779-89df-14a7a5646c13 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:27.374786 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-11dff386-a219-4779-89df-14a7a5646c13 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:27.447123 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-11dff386-a219-4779-89df-14a7a5646c13 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:27.459943 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-11dff386-a219-4779-89df-14a7a5646c13 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1245 microversion: 2.1 time: 0.089149 Apr 08 02:47:27.460890 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 116/240] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:27 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:28.477530 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d335fcd8-1858-467a-a749-17ddf00cc56c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:28.478165 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d335fcd8-1858-467a-a749-17ddf00cc56c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:28.485815 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d335fcd8-1858-467a-a749-17ddf00cc56c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:28.486271 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d335fcd8-1858-467a-a749-17ddf00cc56c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:28.487914 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d335fcd8-1858-467a-a749-17ddf00cc56c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:28.488420 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d335fcd8-1858-467a-a749-17ddf00cc56c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:28.602025 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d335fcd8-1858-467a-a749-17ddf00cc56c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:28.609967 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d335fcd8-1858-467a-a749-17ddf00cc56c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1249 microversion: 2.1 time: 0.136175 Apr 08 02:47:28.610530 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 125/241] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:28 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1249 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:29.627618 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-0808d26f-977a-4990-839a-c7e69225d909 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:29.628272 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-0808d26f-977a-4990-839a-c7e69225d909 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:29.635511 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0808d26f-977a-4990-839a-c7e69225d909 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:29.635983 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0808d26f-977a-4990-839a-c7e69225d909 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:29.636744 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0808d26f-977a-4990-839a-c7e69225d909 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:29.637175 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0808d26f-977a-4990-839a-c7e69225d909 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:29.745642 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0808d26f-977a-4990-839a-c7e69225d909 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:29.754394 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-0808d26f-977a-4990-839a-c7e69225d909 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1249 microversion: 2.1 time: 0.131095 Apr 08 02:47:29.754945 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 117/242] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:29 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1249 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:30.771802 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d39cff06-10c8-4c7e-b2fc-ce9ac750f561 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:30.772471 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d39cff06-10c8-4c7e-b2fc-ce9ac750f561 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:30.780050 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d39cff06-10c8-4c7e-b2fc-ce9ac750f561 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:30.780491 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d39cff06-10c8-4c7e-b2fc-ce9ac750f561 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:30.781247 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d39cff06-10c8-4c7e-b2fc-ce9ac750f561 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:30.781675 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d39cff06-10c8-4c7e-b2fc-ce9ac750f561 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:30.890853 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d39cff06-10c8-4c7e-b2fc-ce9ac750f561 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:30.899333 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d39cff06-10c8-4c7e-b2fc-ce9ac750f561 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1249 microversion: 2.1 time: 0.132219 Apr 08 02:47:30.899879 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 126/243] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:30 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1249 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:31.916027 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-7ffda5b7-3ea3-4f20-96f0-a85c9141ea26 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:31.916670 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-7ffda5b7-3ea3-4f20-96f0-a85c9141ea26 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:31.924576 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7ffda5b7-3ea3-4f20-96f0-a85c9141ea26 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:31.925009 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7ffda5b7-3ea3-4f20-96f0-a85c9141ea26 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:31.925771 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7ffda5b7-3ea3-4f20-96f0-a85c9141ea26 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:31.926204 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7ffda5b7-3ea3-4f20-96f0-a85c9141ea26 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:32.038946 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-7ffda5b7-3ea3-4f20-96f0-a85c9141ea26 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:32.047178 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-7ffda5b7-3ea3-4f20-96f0-a85c9141ea26 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1249 microversion: 2.1 time: 0.134934 Apr 08 02:47:32.047738 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 118/244] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:31 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1249 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:33.065251 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4cfa6394-c1ce-4706-96df-c28c75973b12 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:33.065895 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4cfa6394-c1ce-4706-96df-c28c75973b12 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:33.073620 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4cfa6394-c1ce-4706-96df-c28c75973b12 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:33.074113 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4cfa6394-c1ce-4706-96df-c28c75973b12 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:33.075205 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4cfa6394-c1ce-4706-96df-c28c75973b12 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:33.075640 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4cfa6394-c1ce-4706-96df-c28c75973b12 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:33.202077 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4cfa6394-c1ce-4706-96df-c28c75973b12 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:33.211845 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-4cfa6394-c1ce-4706-96df-c28c75973b12 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1249 microversion: 2.1 time: 0.150929 Apr 08 02:47:33.212647 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 127/245] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:33 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1249 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:34.229567 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5366cce0-1e0d-4bd1-bc82-19896059f96e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:34.230191 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-5366cce0-1e0d-4bd1-bc82-19896059f96e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:34.237964 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5366cce0-1e0d-4bd1-bc82-19896059f96e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:34.238416 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5366cce0-1e0d-4bd1-bc82-19896059f96e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:34.239332 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5366cce0-1e0d-4bd1-bc82-19896059f96e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:34.239771 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5366cce0-1e0d-4bd1-bc82-19896059f96e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:34.417759 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5366cce0-1e0d-4bd1-bc82-19896059f96e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:34.427016 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-5366cce0-1e0d-4bd1-bc82-19896059f96e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1315 microversion: 2.1 time: 0.201722 Apr 08 02:47:34.427647 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 119/246] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:34 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:35.444337 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d9f72fcd-793c-4200-9704-9a9682360521 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:35.445654 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d9f72fcd-793c-4200-9704-9a9682360521 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:35.468488 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d9f72fcd-793c-4200-9704-9a9682360521 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:35.469271 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d9f72fcd-793c-4200-9704-9a9682360521 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:35.475183 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d9f72fcd-793c-4200-9704-9a9682360521 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:35.476075 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d9f72fcd-793c-4200-9704-9a9682360521 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:35.884283 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d9f72fcd-793c-4200-9704-9a9682360521 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:35.893750 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d9f72fcd-793c-4200-9704-9a9682360521 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1371 microversion: 2.1 time: 0.452043 Apr 08 02:47:35.894331 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 128/247] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:35 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1371 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:47:36.397646 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-3e6d2975-2d58-4260-8d08-7676c8696623 req-6c41ecd4-1eff-4051-8845-01da12d1e8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06827ced-06c8-40dd-9ad3-3b5d02590d00", "tag": "32e13942-1502-4bda-aca8-d69e5aacf04a"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:36.400186 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:47:36.400186 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:47:36.414297 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-3e6d2975-2d58-4260-8d08-7676c8696623 req-6c41ecd4-1eff-4051-8845-01da12d1e8f4 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:36.416430 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-3e6d2975-2d58-4260-8d08-7676c8696623 req-6c41ecd4-1eff-4051-8845-01da12d1e8f4 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:36.439087 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-3e6d2975-2d58-4260-8d08-7676c8696623 req-6c41ecd4-1eff-4051-8845-01da12d1e8f4 service nova] Creating event network-changed:32e13942-1502-4bda-aca8-d69e5aacf04a for instance 06827ced-06c8-40dd-9ad3-3b5d02590d00 on hv-cinder-83705 Apr 08 02:47:36.444444 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-3e6d2975-2d58-4260-8d08-7676c8696623 req-6c41ecd4-1eff-4051-8845-01da12d1e8f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056781 Apr 08 02:47:36.445026 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 120/248] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:47:36.911175 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0204cf4d-31c1-4ae9-b4c0-968a28ea59e3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:36.911866 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0204cf4d-31c1-4ae9-b4c0-968a28ea59e3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:36.919876 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0204cf4d-31c1-4ae9-b4c0-968a28ea59e3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:36.920353 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0204cf4d-31c1-4ae9-b4c0-968a28ea59e3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:36.921123 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0204cf4d-31c1-4ae9-b4c0-968a28ea59e3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:36.921580 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0204cf4d-31c1-4ae9-b4c0-968a28ea59e3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:37.238492 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0204cf4d-31c1-4ae9-b4c0-968a28ea59e3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:37.246794 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0204cf4d-31c1-4ae9-b4c0-968a28ea59e3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1371 microversion: 2.1 time: 0.340058 Apr 08 02:47:37.247368 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 129/249] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:36 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:38.263778 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b63495fb-054e-43df-b15e-d0da83cbf4aa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:38.264477 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b63495fb-054e-43df-b15e-d0da83cbf4aa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:38.272512 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b63495fb-054e-43df-b15e-d0da83cbf4aa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:38.272955 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b63495fb-054e-43df-b15e-d0da83cbf4aa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:38.273713 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b63495fb-054e-43df-b15e-d0da83cbf4aa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:38.274145 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b63495fb-054e-43df-b15e-d0da83cbf4aa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:38.471777 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b63495fb-054e-43df-b15e-d0da83cbf4aa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:38.480259 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b63495fb-054e-43df-b15e-d0da83cbf4aa tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1371 microversion: 2.1 time: 0.220673 Apr 08 02:47:38.480915 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 121/250] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:38 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:39.496063 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d9fa6679-801e-426a-940e-b397a2917c18] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 08 02:47:39.499358 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b0601d75-407b-4a3e-ab87-b663a77b9569 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:39.499982 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b0601d75-407b-4a3e-ab87-b663a77b9569 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:39.509262 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b0601d75-407b-4a3e-ab87-b663a77b9569 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:39.509742 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b0601d75-407b-4a3e-ab87-b663a77b9569 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:39.510568 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b0601d75-407b-4a3e-ab87-b663a77b9569 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:39.511022 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b0601d75-407b-4a3e-ab87-b663a77b9569 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:39.709038 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b0601d75-407b-4a3e-ab87-b663a77b9569 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:39.717040 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b0601d75-407b-4a3e-ab87-b663a77b9569 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1371 microversion: 2.1 time: 0.222517 Apr 08 02:47:39.717595 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 130/251] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:39 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:40.733747 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4ad00645-06ab-4968-b98c-defb3fa21b34 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:40.734354 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-4ad00645-06ab-4968-b98c-defb3fa21b34 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:40.742057 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4ad00645-06ab-4968-b98c-defb3fa21b34 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:40.742498 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4ad00645-06ab-4968-b98c-defb3fa21b34 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:40.743260 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4ad00645-06ab-4968-b98c-defb3fa21b34 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:40.743688 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4ad00645-06ab-4968-b98c-defb3fa21b34 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:40.945765 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4ad00645-06ab-4968-b98c-defb3fa21b34 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:40.953843 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4ad00645-06ab-4968-b98c-defb3fa21b34 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1371 microversion: 2.1 time: 0.223845 Apr 08 02:47:40.954397 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 122/252] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:40 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:41.972168 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4f3e7c4f-3275-47fd-869a-3b5dd22a459b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:41.972790 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4f3e7c4f-3275-47fd-869a-3b5dd22a459b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:41.982425 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4f3e7c4f-3275-47fd-869a-3b5dd22a459b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:41.983288 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4f3e7c4f-3275-47fd-869a-3b5dd22a459b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:41.985586 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4f3e7c4f-3275-47fd-869a-3b5dd22a459b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:41.986908 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4f3e7c4f-3275-47fd-869a-3b5dd22a459b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:42.023429 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO oslo.messaging._drivers.impl_rabbit [-] [d9fa6679-801e-426a-940e-b397a2917c18] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 56800. Apr 08 02:47:42.316123 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4f3e7c4f-3275-47fd-869a-3b5dd22a459b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:42.324140 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-4f3e7c4f-3275-47fd-869a-3b5dd22a459b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1371 microversion: 2.1 time: 0.357369 Apr 08 02:47:42.324709 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 131/253] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:41 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1371 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:43.341346 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5b1eb746-50d0-4dcb-8b0c-e922e1907176 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:43.342070 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-5b1eb746-50d0-4dcb-8b0c-e922e1907176 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:43.349844 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5b1eb746-50d0-4dcb-8b0c-e922e1907176 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:43.350295 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5b1eb746-50d0-4dcb-8b0c-e922e1907176 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:43.351061 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5b1eb746-50d0-4dcb-8b0c-e922e1907176 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:43.351499 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5b1eb746-50d0-4dcb-8b0c-e922e1907176 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:43.555536 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5b1eb746-50d0-4dcb-8b0c-e922e1907176 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:43.563576 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-5b1eb746-50d0-4dcb-8b0c-e922e1907176 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1371 microversion: 2.1 time: 0.226077 Apr 08 02:47:43.564233 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 123/254] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:43 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:44.581281 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0679e1db-d007-433a-9696-3e54c445c544 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:44.581892 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0679e1db-d007-433a-9696-3e54c445c544 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:44.589152 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0679e1db-d007-433a-9696-3e54c445c544 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:44.589602 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0679e1db-d007-433a-9696-3e54c445c544 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:44.590369 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0679e1db-d007-433a-9696-3e54c445c544 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:44.590803 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0679e1db-d007-433a-9696-3e54c445c544 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:44.782054 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0679e1db-d007-433a-9696-3e54c445c544 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:44.791016 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0679e1db-d007-433a-9696-3e54c445c544 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1371 microversion: 2.1 time: 0.213726 Apr 08 02:47:44.791570 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 132/255] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:44 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:45.797356 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-7258de02-c22c-4212-b63e-9de82fcc73a3 req-7fa93699-9af2-48a8-8b55-8be61383ed72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06827ced-06c8-40dd-9ad3-3b5d02590d00", "name": "network-vif-plugged", "status": "completed", "tag": "32e13942-1502-4bda-aca8-d69e5aacf04a"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:45.799631 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:47:45.799631 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:47:45.808631 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-7258de02-c22c-4212-b63e-9de82fcc73a3 req-7fa93699-9af2-48a8-8b55-8be61383ed72 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:45.809074 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-7258de02-c22c-4212-b63e-9de82fcc73a3 req-7fa93699-9af2-48a8-8b55-8be61383ed72 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:45.810405 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-31c1366f-7faf-457b-9251-c74b2c550bf9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:45.812339 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-31c1366f-7faf-457b-9251-c74b2c550bf9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:45.824123 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-31c1366f-7faf-457b-9251-c74b2c550bf9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:45.825107 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-31c1366f-7faf-457b-9251-c74b2c550bf9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:45.825956 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-7258de02-c22c-4212-b63e-9de82fcc73a3 req-7fa93699-9af2-48a8-8b55-8be61383ed72 service nova] Creating event network-vif-plugged:32e13942-1502-4bda-aca8-d69e5aacf04a for instance 06827ced-06c8-40dd-9ad3-3b5d02590d00 on hv-cinder-83705 Apr 08 02:47:45.826347 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-31c1366f-7faf-457b-9251-c74b2c550bf9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:45.827153 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-31c1366f-7faf-457b-9251-c74b2c550bf9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:45.832006 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-7258de02-c22c-4212-b63e-9de82fcc73a3 req-7fa93699-9af2-48a8-8b55-8be61383ed72 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039762 Apr 08 02:47:45.833092 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 124/256] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:47:46.289931 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-31c1366f-7faf-457b-9251-c74b2c550bf9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:46.298046 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-31c1366f-7faf-457b-9251-c74b2c550bf9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1371 microversion: 2.1 time: 0.493088 Apr 08 02:47:46.298637 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 133/257] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:45 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1371 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:47:47.315196 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4e5ab8f1-ee47-4bed-8296-750e298e1408 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:47.315898 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-4e5ab8f1-ee47-4bed-8296-750e298e1408 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:47.323386 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4e5ab8f1-ee47-4bed-8296-750e298e1408 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:47.323835 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4e5ab8f1-ee47-4bed-8296-750e298e1408 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:47.324639 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4e5ab8f1-ee47-4bed-8296-750e298e1408 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:47.325074 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4e5ab8f1-ee47-4bed-8296-750e298e1408 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:47.522986 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4e5ab8f1-ee47-4bed-8296-750e298e1408 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:47.531024 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4e5ab8f1-ee47-4bed-8296-750e298e1408 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1371 microversion: 2.1 time: 0.220406 Apr 08 02:47:47.531578 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 125/258] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:47 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:48.547366 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-483e5b26-ecb7-4507-b24a-3dce3a20188c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:48.547987 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-483e5b26-ecb7-4507-b24a-3dce3a20188c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:48.556577 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-483e5b26-ecb7-4507-b24a-3dce3a20188c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:48.557019 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-483e5b26-ecb7-4507-b24a-3dce3a20188c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:48.557767 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-483e5b26-ecb7-4507-b24a-3dce3a20188c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:48.558192 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-483e5b26-ecb7-4507-b24a-3dce3a20188c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:48.747163 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-483e5b26-ecb7-4507-b24a-3dce3a20188c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:48.757471 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-483e5b26-ecb7-4507-b24a-3dce3a20188c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1371 microversion: 2.1 time: 0.213757 Apr 08 02:47:48.758027 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 134/259] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:48 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:49.773823 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2f8682ac-a7d0-492b-9f22-9e563daf4101 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:49.774430 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2f8682ac-a7d0-492b-9f22-9e563daf4101 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:49.783786 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2f8682ac-a7d0-492b-9f22-9e563daf4101 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:49.784203 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2f8682ac-a7d0-492b-9f22-9e563daf4101 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:49.784957 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2f8682ac-a7d0-492b-9f22-9e563daf4101 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:49.785387 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2f8682ac-a7d0-492b-9f22-9e563daf4101 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:49.978069 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2f8682ac-a7d0-492b-9f22-9e563daf4101 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:49.986115 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2f8682ac-a7d0-492b-9f22-9e563daf4101 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1371 microversion: 2.1 time: 0.215979 Apr 08 02:47:49.986677 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 126/260] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:49 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:51.003399 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-22bce9b0-4fa1-4f0a-a8b1-7449ffacff8e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:51.004063 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-22bce9b0-4fa1-4f0a-a8b1-7449ffacff8e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:51.011326 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-22bce9b0-4fa1-4f0a-a8b1-7449ffacff8e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:51.011770 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-22bce9b0-4fa1-4f0a-a8b1-7449ffacff8e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:51.012563 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-22bce9b0-4fa1-4f0a-a8b1-7449ffacff8e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:51.012996 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-22bce9b0-4fa1-4f0a-a8b1-7449ffacff8e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:51.220732 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-22bce9b0-4fa1-4f0a-a8b1-7449ffacff8e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:51.228694 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-22bce9b0-4fa1-4f0a-a8b1-7449ffacff8e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1371 microversion: 2.1 time: 0.229702 Apr 08 02:47:51.229270 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 135/261] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:50 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:52.245794 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-3c363984-625d-41c9-8ec3-55d676eb5bb9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:52.246392 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-3c363984-625d-41c9-8ec3-55d676eb5bb9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:52.254020 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3c363984-625d-41c9-8ec3-55d676eb5bb9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:52.254465 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3c363984-625d-41c9-8ec3-55d676eb5bb9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:52.255209 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3c363984-625d-41c9-8ec3-55d676eb5bb9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:52.255636 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3c363984-625d-41c9-8ec3-55d676eb5bb9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:52.453325 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3c363984-625d-41c9-8ec3-55d676eb5bb9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:52.462235 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-3c363984-625d-41c9-8ec3-55d676eb5bb9 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1371 microversion: 2.1 time: 0.220113 Apr 08 02:47:52.463010 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 127/262] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:52 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:53.480981 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-270c31a9-a8b3-4049-afe1-e72d3d0d732b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:53.481820 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-270c31a9-a8b3-4049-afe1-e72d3d0d732b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:53.491762 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-270c31a9-a8b3-4049-afe1-e72d3d0d732b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:53.493232 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-270c31a9-a8b3-4049-afe1-e72d3d0d732b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:53.494102 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-270c31a9-a8b3-4049-afe1-e72d3d0d732b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:53.494735 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-270c31a9-a8b3-4049-afe1-e72d3d0d732b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:53.705786 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-270c31a9-a8b3-4049-afe1-e72d3d0d732b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:47:53.714865 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-270c31a9-a8b3-4049-afe1-e72d3d0d732b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1566 microversion: 2.1 time: 0.239954 Apr 08 02:47:53.715731 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 136/263] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:53 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:53.732706 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-05f5a898-bdfa-408a-990d-22958bfee461 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:53.733242 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-05f5a898-bdfa-408a-990d-22958bfee461 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:53.741017 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-05f5a898-bdfa-408a-990d-22958bfee461 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:53.741471 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-05f5a898-bdfa-408a-990d-22958bfee461 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:53.742243 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-05f5a898-bdfa-408a-990d-22958bfee461 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:53.742671 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-05f5a898-bdfa-408a-990d-22958bfee461 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:53.750413 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2ba9aa1b-9fdb-40f8-83b7-686ea222876d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc17d1da-12c3-4ce6-bb31-0e2e4bfe7fb4", "device": "/dev/sdb"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:53.753333 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2ba9aa1b-9fdb-40f8-83b7-686ea222876d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:47:53.761754 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2ba9aa1b-9fdb-40f8-83b7-686ea222876d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:53.762213 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2ba9aa1b-9fdb-40f8-83b7-686ea222876d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:53.763362 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2ba9aa1b-9fdb-40f8-83b7-686ea222876d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:53.764008 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2ba9aa1b-9fdb-40f8-83b7-686ea222876d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:53.899463 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-05f5a898-bdfa-408a-990d-22958bfee461 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.171041 Apr 08 02:47:53.900337 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 128/264] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Apr 8 02:47:53 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:47:54.178873 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2ba9aa1b-9fdb-40f8-83b7-686ea222876d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "POST /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432134 Apr 08 02:47:54.179479 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 137/265] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Apr 8 02:47:53 2022] POST /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:47:55.466410 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-12e9067f-b700-4a18-906a-12d7c56c9bf6 req-b856a07a-93c7-4b1b-ad5f-9e0ee735cf19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06827ced-06c8-40dd-9ad3-3b5d02590d00", "tag": "32e13942-1502-4bda-aca8-d69e5aacf04a"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:55.468004 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:47:55.468004 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:47:55.477562 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-12e9067f-b700-4a18-906a-12d7c56c9bf6 req-b856a07a-93c7-4b1b-ad5f-9e0ee735cf19 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:55.478007 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-12e9067f-b700-4a18-906a-12d7c56c9bf6 req-b856a07a-93c7-4b1b-ad5f-9e0ee735cf19 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:55.495746 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-12e9067f-b700-4a18-906a-12d7c56c9bf6 req-b856a07a-93c7-4b1b-ad5f-9e0ee735cf19 service nova] Creating event network-changed:32e13942-1502-4bda-aca8-d69e5aacf04a for instance 06827ced-06c8-40dd-9ad3-3b5d02590d00 on hv-cinder-83705 Apr 08 02:47:55.503140 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-12e9067f-b700-4a18-906a-12d7c56c9bf6 req-b856a07a-93c7-4b1b-ad5f-9e0ee735cf19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038935 Apr 08 02:47:55.503887 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 129/266] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:48:08.075856 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0c48772d-c482-4e0d-b40a-18ed3d3b5f9b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:08.076638 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0c48772d-c482-4e0d-b40a-18ed3d3b5f9b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:08.088639 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0c48772d-c482-4e0d-b40a-18ed3d3b5f9b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:08.089095 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0c48772d-c482-4e0d-b40a-18ed3d3b5f9b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:08.089883 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0c48772d-c482-4e0d-b40a-18ed3d3b5f9b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:08.090324 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0c48772d-c482-4e0d-b40a-18ed3d3b5f9b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:08.153215 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0c48772d-c482-4e0d-b40a-18ed3d3b5f9b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/ips" status: 200 len: 145 microversion: 2.1 time: 0.082247 Apr 08 02:48:08.153785 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 138/267] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Apr 8 02:48:08 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/ips => generated 145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:48:21.476954 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-42c23214-f180-472a-b199-210f10518999 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:21.477515 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-42c23214-f180-472a-b199-210f10518999 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:21.485989 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-42c23214-f180-472a-b199-210f10518999 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:21.486434 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-42c23214-f180-472a-b199-210f10518999 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:21.492079 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-42c23214-f180-472a-b199-210f10518999 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:21.492079 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-42c23214-f180-472a-b199-210f10518999 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:21.550727 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-42c23214-f180-472a-b199-210f10518999 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/ips" status: 200 len: 152 microversion: 2.20 time: 0.078014 Apr 08 02:48:21.551564 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 130/268] 10.222.0.23 () {60 vars in 1288 bytes} [Fri Apr 8 02:48:21 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/ips => generated 152 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:48:21.976835 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-7f57c647-a932-4dd4-939b-ce154c369b02 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d72fce49-f1f5-4361-9521-d2c0ea63448f"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:48:21.977956 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-7f57c647-a932-4dd4-939b-ce154c369b02 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:21.985780 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7f57c647-a932-4dd4-939b-ce154c369b02 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:21.986223 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7f57c647-a932-4dd4-939b-ce154c369b02 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:21.986981 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7f57c647-a932-4dd4-939b-ce154c369b02 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:21.987412 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7f57c647-a932-4dd4-939b-ce154c369b02 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:22.373830 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-7f57c647-a932-4dd4-939b-ce154c369b02 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "POST /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.401000 Apr 08 02:48:22.374386 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 139/269] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Apr 8 02:48:21 2022] POST /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/os-volume_attachments => generated 194 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:48:22.671321 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1a657d37-32f0-48cd-9ede-4fd13b95e5f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:22.672398 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1a657d37-32f0-48cd-9ede-4fd13b95e5f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:22.679624 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1a657d37-32f0-48cd-9ede-4fd13b95e5f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:22.680101 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1a657d37-32f0-48cd-9ede-4fd13b95e5f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:22.680878 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1a657d37-32f0-48cd-9ede-4fd13b95e5f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:22.681390 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1a657d37-32f0-48cd-9ede-4fd13b95e5f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:22.738389 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1a657d37-32f0-48cd-9ede-4fd13b95e5f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237/ips" status: 200 len: 148 microversion: 2.1 time: 0.070528 Apr 08 02:48:22.738962 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 131/270] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Apr 8 02:48:22 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237/ips => generated 148 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:48:23.680202 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-33f3a38a-6925-4df6-ba25-bd0cf913718c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:48:23.680915 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-33f3a38a-6925-4df6-ba25-bd0cf913718c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:23.689842 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-33f3a38a-6925-4df6-ba25-bd0cf913718c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:23.690290 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-33f3a38a-6925-4df6-ba25-bd0cf913718c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:23.691057 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-33f3a38a-6925-4df6-ba25-bd0cf913718c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:23.691494 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-33f3a38a-6925-4df6-ba25-bd0cf913718c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:23.766848 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.objects.instance [None req-33f3a38a-6925-4df6-ba25-bd0cf913718c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lazy-loading 'flavor' on Instance uuid 89a1344c-2d91-4224-ab68-1898d4aa8b0f {{(pid=101272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:48:24.114368 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-33f3a38a-6925-4df6-ba25-bd0cf913718c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "POST /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/action" status: 202 len: 0 microversion: 2.20 time: 0.439158 Apr 08 02:48:24.118295 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 140/271] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Apr 8 02:48:23 2022] POST /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:48:24.125743 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5653324f-e9ac-4f92-bb80-53e6ab2872db tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:24.127137 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-5653324f-e9ac-4f92-bb80-53e6ab2872db tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:24.134738 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5653324f-e9ac-4f92-bb80-53e6ab2872db tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:24.135659 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5653324f-e9ac-4f92-bb80-53e6ab2872db tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:24.136581 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5653324f-e9ac-4f92-bb80-53e6ab2872db tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:24.136957 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5653324f-e9ac-4f92-bb80-53e6ab2872db tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:24.345427 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1bbb40ec-0d8d-4809-9f91-241d0bb42344 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1736d6fd-791b-4949-a1c2-a2c0dabeefca"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:48:24.346181 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5653324f-e9ac-4f92-bb80-53e6ab2872db tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:24.346563 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1bbb40ec-0d8d-4809-9f91-241d0bb42344 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:24.353994 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1bbb40ec-0d8d-4809-9f91-241d0bb42344 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:24.354437 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1bbb40ec-0d8d-4809-9f91-241d0bb42344 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:24.355063 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5653324f-e9ac-4f92-bb80-53e6ab2872db tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:24.355201 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1bbb40ec-0d8d-4809-9f91-241d0bb42344 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:24.355634 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1bbb40ec-0d8d-4809-9f91-241d0bb42344 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:24.356813 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5653324f-e9ac-4f92-bb80-53e6ab2872db tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:24.357942 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-5653324f-e9ac-4f92-bb80-53e6ab2872db tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1723 microversion: 2.20 time: 0.236851 Apr 08 02:48:24.358492 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 132/272] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:24 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:24.768623 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1bbb40ec-0d8d-4809-9f91-241d0bb42344 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "POST /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426821 Apr 08 02:48:24.774229 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 141/273] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Apr 8 02:48:24 2022] POST /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:48:25.303211 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-02bf36d7-f991-4803-b59b-f93d578d7bfe tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:25.303705 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-02bf36d7-f991-4803-b59b-f93d578d7bfe tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:25.310756 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-02bf36d7-f991-4803-b59b-f93d578d7bfe tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:25.311201 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-02bf36d7-f991-4803-b59b-f93d578d7bfe tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:25.311998 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-02bf36d7-f991-4803-b59b-f93d578d7bfe tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:25.312978 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-02bf36d7-f991-4803-b59b-f93d578d7bfe tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:25.378633 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-7f252310-4eab-46ff-ac96-26679110f04e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:25.379428 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-7f252310-4eab-46ff-ac96-26679110f04e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:25.391577 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7f252310-4eab-46ff-ac96-26679110f04e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:25.392127 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7f252310-4eab-46ff-ac96-26679110f04e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:25.392891 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7f252310-4eab-46ff-ac96-26679110f04e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:25.393373 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7f252310-4eab-46ff-ac96-26679110f04e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:25.481471 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.objects.instance [None req-02bf36d7-f991-4803-b59b-f93d578d7bfe tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lazy-loading 'services' on Instance uuid 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe {{(pid=101271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:48:25.616119 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-7f252310-4eab-46ff-ac96-26679110f04e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:25.626676 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-7f252310-4eab-46ff-ac96-26679110f04e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:25.628306 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-7f252310-4eab-46ff-ac96-26679110f04e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:25.629456 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-7f252310-4eab-46ff-ac96-26679110f04e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1723 microversion: 2.20 time: 0.256000 Apr 08 02:48:25.631280 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 142/274] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:25 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:48:25.644291 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-02bf36d7-f991-4803-b59b-f93d578d7bfe tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe/os-volume_attachments/fc17d1da-12c3-4ce6-bb31-0e2e4bfe7fb4" status: 202 len: 0 microversion: 2.1 time: 0.344855 Apr 08 02:48:25.644885 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 133/275] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Apr 8 02:48:25 2022] DELETE /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe/os-volume_attachments/fc17d1da-12c3-4ce6-bb31-0e2e4bfe7fb4 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:48:26.649029 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-8e16200c-36cb-4341-9a03-8d6eda34f30d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:26.649632 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-8e16200c-36cb-4341-9a03-8d6eda34f30d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:26.656915 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8e16200c-36cb-4341-9a03-8d6eda34f30d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:26.657352 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8e16200c-36cb-4341-9a03-8d6eda34f30d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:26.658106 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8e16200c-36cb-4341-9a03-8d6eda34f30d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:26.658533 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8e16200c-36cb-4341-9a03-8d6eda34f30d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:26.853128 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-8e16200c-36cb-4341-9a03-8d6eda34f30d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:26.862384 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-8e16200c-36cb-4341-9a03-8d6eda34f30d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:26.863884 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-8e16200c-36cb-4341-9a03-8d6eda34f30d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:26.865029 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-8e16200c-36cb-4341-9a03-8d6eda34f30d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1723 microversion: 2.20 time: 0.219915 Apr 08 02:48:26.865583 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 143/276] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:26 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:27.883379 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5d7b0c00-d749-457a-acf3-b7e32060f0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:27.884040 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-5d7b0c00-d749-457a-acf3-b7e32060f0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:27.891982 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5d7b0c00-d749-457a-acf3-b7e32060f0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:27.892432 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5d7b0c00-d749-457a-acf3-b7e32060f0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:27.893202 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5d7b0c00-d749-457a-acf3-b7e32060f0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:27.893633 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5d7b0c00-d749-457a-acf3-b7e32060f0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:28.086421 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5d7b0c00-d749-457a-acf3-b7e32060f0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:28.095653 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5d7b0c00-d749-457a-acf3-b7e32060f0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:28.097264 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5d7b0c00-d749-457a-acf3-b7e32060f0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:28.098356 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-5d7b0c00-d749-457a-acf3-b7e32060f0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1723 microversion: 2.20 time: 0.219125 Apr 08 02:48:28.098932 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 134/277] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:27 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:29.116070 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2a79d726-bb16-4c6f-937d-51349e841432 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:29.116687 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2a79d726-bb16-4c6f-937d-51349e841432 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:29.124170 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2a79d726-bb16-4c6f-937d-51349e841432 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:29.124623 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2a79d726-bb16-4c6f-937d-51349e841432 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:29.125392 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2a79d726-bb16-4c6f-937d-51349e841432 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:29.125828 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2a79d726-bb16-4c6f-937d-51349e841432 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:29.318349 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2a79d726-bb16-4c6f-937d-51349e841432 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:29.326855 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2a79d726-bb16-4c6f-937d-51349e841432 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:29.328476 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2a79d726-bb16-4c6f-937d-51349e841432 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:29.329599 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2a79d726-bb16-4c6f-937d-51349e841432 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1723 microversion: 2.20 time: 0.217183 Apr 08 02:48:29.330149 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 144/278] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:29 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:30.348260 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c9aad755-35e5-4bbd-a764-ec7b876b7dee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:30.348902 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c9aad755-35e5-4bbd-a764-ec7b876b7dee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:30.356100 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c9aad755-35e5-4bbd-a764-ec7b876b7dee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:30.356544 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c9aad755-35e5-4bbd-a764-ec7b876b7dee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:30.357315 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c9aad755-35e5-4bbd-a764-ec7b876b7dee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:30.357746 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c9aad755-35e5-4bbd-a764-ec7b876b7dee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:30.616658 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c9aad755-35e5-4bbd-a764-ec7b876b7dee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:30.625742 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c9aad755-35e5-4bbd-a764-ec7b876b7dee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:30.627228 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c9aad755-35e5-4bbd-a764-ec7b876b7dee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:30.628366 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c9aad755-35e5-4bbd-a764-ec7b876b7dee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1723 microversion: 2.20 time: 0.283835 Apr 08 02:48:30.628914 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 135/279] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:30 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:31.282722 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-71f710c3-e8c1-4d83-b7db-bd2613ac1e5a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:48:31.289984 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-71f710c3-e8c1-4d83-b7db-bd2613ac1e5a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:31.290436 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-71f710c3-e8c1-4d83-b7db-bd2613ac1e5a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:31.350308 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-71f710c3-e8c1-4d83-b7db-bd2613ac1e5a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Going to try to stop instance {{(pid=101272) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Apr 08 02:48:31.425789 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-71f710c3-e8c1-4d83-b7db-bd2613ac1e5a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "POST /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/action" status: 202 len: 0 microversion: 2.1 time: 0.147428 Apr 08 02:48:31.426607 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 145/280] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Apr 8 02:48:31 2022] POST /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:48:31.434750 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8a7ac192-c5e4-4c76-aa03-477a1685251c tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:31.435363 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-8a7ac192-c5e4-4c76-aa03-477a1685251c tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:31.442876 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8a7ac192-c5e4-4c76-aa03-477a1685251c tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:31.443722 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8a7ac192-c5e4-4c76-aa03-477a1685251c tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:31.444559 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8a7ac192-c5e4-4c76-aa03-477a1685251c tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:31.445070 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8a7ac192-c5e4-4c76-aa03-477a1685251c tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:31.647564 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2505e5d7-2016-457b-9a7a-edaf8ee51d21 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:31.648419 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2505e5d7-2016-457b-9a7a-edaf8ee51d21 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:31.655255 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-8a7ac192-c5e4-4c76-aa03-477a1685251c tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:31.656390 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2505e5d7-2016-457b-9a7a-edaf8ee51d21 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:31.656850 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2505e5d7-2016-457b-9a7a-edaf8ee51d21 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:31.657634 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2505e5d7-2016-457b-9a7a-edaf8ee51d21 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:31.658068 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2505e5d7-2016-457b-9a7a-edaf8ee51d21 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:31.664788 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8a7ac192-c5e4-4c76-aa03-477a1685251c tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1721 microversion: 2.1 time: 0.233765 Apr 08 02:48:31.665228 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 136/281] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:31 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:31.864407 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2505e5d7-2016-457b-9a7a-edaf8ee51d21 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:31.872981 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2505e5d7-2016-457b-9a7a-edaf8ee51d21 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:31.874937 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2505e5d7-2016-457b-9a7a-edaf8ee51d21 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:31.876090 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2505e5d7-2016-457b-9a7a-edaf8ee51d21 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1723 microversion: 2.20 time: 0.232675 Apr 08 02:48:31.876643 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 146/282] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:31 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:48:32.683502 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-56d28dfd-b99b-4268-ba8d-69cd2c0e7a83 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:32.684165 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-56d28dfd-b99b-4268-ba8d-69cd2c0e7a83 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:32.693108 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-56d28dfd-b99b-4268-ba8d-69cd2c0e7a83 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:32.693921 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-56d28dfd-b99b-4268-ba8d-69cd2c0e7a83 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:32.694741 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-56d28dfd-b99b-4268-ba8d-69cd2c0e7a83 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:32.695177 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-56d28dfd-b99b-4268-ba8d-69cd2c0e7a83 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:32.884538 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-56d28dfd-b99b-4268-ba8d-69cd2c0e7a83 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:32.893756 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-56d28dfd-b99b-4268-ba8d-69cd2c0e7a83 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1721 microversion: 2.1 time: 0.215151 Apr 08 02:48:32.894319 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 137/283] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:32 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:32.895149 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-409cf596-7b98-42b6-9f44-d83d359b2755 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:32.895770 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-409cf596-7b98-42b6-9f44-d83d359b2755 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:32.902913 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-409cf596-7b98-42b6-9f44-d83d359b2755 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:32.903359 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-409cf596-7b98-42b6-9f44-d83d359b2755 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:32.904151 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-409cf596-7b98-42b6-9f44-d83d359b2755 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:32.904585 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-409cf596-7b98-42b6-9f44-d83d359b2755 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:33.101181 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-409cf596-7b98-42b6-9f44-d83d359b2755 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:33.111675 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-409cf596-7b98-42b6-9f44-d83d359b2755 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:33.114177 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-409cf596-7b98-42b6-9f44-d83d359b2755 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:33.115685 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-409cf596-7b98-42b6-9f44-d83d359b2755 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1723 microversion: 2.20 time: 0.224371 Apr 08 02:48:33.116282 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 147/284] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:32 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:48:33.911043 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-487fcded-8525-40da-8419-d98f8956f076 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:33.911580 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-487fcded-8525-40da-8419-d98f8956f076 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:33.918890 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-487fcded-8525-40da-8419-d98f8956f076 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:33.919339 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-487fcded-8525-40da-8419-d98f8956f076 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:33.920135 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-487fcded-8525-40da-8419-d98f8956f076 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:33.920571 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-487fcded-8525-40da-8419-d98f8956f076 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:34.118075 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-487fcded-8525-40da-8419-d98f8956f076 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:34.127843 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-487fcded-8525-40da-8419-d98f8956f076 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1721 microversion: 2.1 time: 0.220638 Apr 08 02:48:34.128486 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 138/285] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:33 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:34.135846 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ed7a7aec-7904-49b6-8de8-251e11312543 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:34.136474 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ed7a7aec-7904-49b6-8de8-251e11312543 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:34.145947 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ed7a7aec-7904-49b6-8de8-251e11312543 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:34.146396 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ed7a7aec-7904-49b6-8de8-251e11312543 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:34.147168 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ed7a7aec-7904-49b6-8de8-251e11312543 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:34.147596 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ed7a7aec-7904-49b6-8de8-251e11312543 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:34.451134 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ed7a7aec-7904-49b6-8de8-251e11312543 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:34.463213 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ed7a7aec-7904-49b6-8de8-251e11312543 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:34.464709 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ed7a7aec-7904-49b6-8de8-251e11312543 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:34.465829 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ed7a7aec-7904-49b6-8de8-251e11312543 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1723 microversion: 2.20 time: 0.333941 Apr 08 02:48:34.466596 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 148/286] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:34 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:48:35.145880 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-37311ac4-260d-4591-ba96-47b5cfc469bf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:35.146480 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-37311ac4-260d-4591-ba96-47b5cfc469bf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:35.153808 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-37311ac4-260d-4591-ba96-47b5cfc469bf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:35.154250 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-37311ac4-260d-4591-ba96-47b5cfc469bf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:35.154998 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-37311ac4-260d-4591-ba96-47b5cfc469bf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:35.155956 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-37311ac4-260d-4591-ba96-47b5cfc469bf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:35.351636 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-37311ac4-260d-4591-ba96-47b5cfc469bf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:35.361155 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-37311ac4-260d-4591-ba96-47b5cfc469bf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1721 microversion: 2.1 time: 0.218985 Apr 08 02:48:35.361711 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 139/287] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:35 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:35.484778 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-493deabe-75f5-4e25-aed7-f1fd1f66dc78 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:35.485421 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-493deabe-75f5-4e25-aed7-f1fd1f66dc78 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:35.492964 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-493deabe-75f5-4e25-aed7-f1fd1f66dc78 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:35.493428 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-493deabe-75f5-4e25-aed7-f1fd1f66dc78 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:35.494176 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-493deabe-75f5-4e25-aed7-f1fd1f66dc78 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:35.494612 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-493deabe-75f5-4e25-aed7-f1fd1f66dc78 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:35.691848 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-493deabe-75f5-4e25-aed7-f1fd1f66dc78 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:35.700495 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-493deabe-75f5-4e25-aed7-f1fd1f66dc78 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:35.702002 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-493deabe-75f5-4e25-aed7-f1fd1f66dc78 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:35.703609 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-493deabe-75f5-4e25-aed7-f1fd1f66dc78 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1723 microversion: 2.20 time: 0.222925 Apr 08 02:48:35.704181 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 149/288] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:35 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:36.378715 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f9539b49-79bf-4d5e-9aee-b7aba3ecdb52 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:36.379321 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f9539b49-79bf-4d5e-9aee-b7aba3ecdb52 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:36.386523 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f9539b49-79bf-4d5e-9aee-b7aba3ecdb52 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:36.386965 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f9539b49-79bf-4d5e-9aee-b7aba3ecdb52 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:36.387715 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f9539b49-79bf-4d5e-9aee-b7aba3ecdb52 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:36.388178 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f9539b49-79bf-4d5e-9aee-b7aba3ecdb52 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:36.579679 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f9539b49-79bf-4d5e-9aee-b7aba3ecdb52 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:36.588185 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f9539b49-79bf-4d5e-9aee-b7aba3ecdb52 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1721 microversion: 2.1 time: 0.213855 Apr 08 02:48:36.588741 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 140/289] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:36 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:36.722332 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-a86c9dcc-2e33-4691-9913-4105f2d74864 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:36.722942 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-a86c9dcc-2e33-4691-9913-4105f2d74864 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:36.730155 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a86c9dcc-2e33-4691-9913-4105f2d74864 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:36.730602 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a86c9dcc-2e33-4691-9913-4105f2d74864 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:36.731368 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a86c9dcc-2e33-4691-9913-4105f2d74864 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:36.731806 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a86c9dcc-2e33-4691-9913-4105f2d74864 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:36.925936 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a86c9dcc-2e33-4691-9913-4105f2d74864 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:36.934825 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a86c9dcc-2e33-4691-9913-4105f2d74864 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:36.936357 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a86c9dcc-2e33-4691-9913-4105f2d74864 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:36.937517 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-a86c9dcc-2e33-4691-9913-4105f2d74864 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1744 microversion: 2.20 time: 0.219615 Apr 08 02:48:36.938053 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 150/290] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:36 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:37.605958 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1b37c264-4da6-4710-8072-8cbca7838b82 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:37.606559 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1b37c264-4da6-4710-8072-8cbca7838b82 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:37.614868 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1b37c264-4da6-4710-8072-8cbca7838b82 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:37.615329 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1b37c264-4da6-4710-8072-8cbca7838b82 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:37.616115 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1b37c264-4da6-4710-8072-8cbca7838b82 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:37.616544 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1b37c264-4da6-4710-8072-8cbca7838b82 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:37.814452 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1b37c264-4da6-4710-8072-8cbca7838b82 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:37.823943 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1b37c264-4da6-4710-8072-8cbca7838b82 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1721 microversion: 2.1 time: 0.221622 Apr 08 02:48:37.824850 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 141/291] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:37 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:37.955762 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0f3c85fe-80f5-4436-b097-a65d4578da8b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:37.956391 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0f3c85fe-80f5-4436-b097-a65d4578da8b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:37.963866 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0f3c85fe-80f5-4436-b097-a65d4578da8b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:37.964350 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0f3c85fe-80f5-4436-b097-a65d4578da8b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:37.965147 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0f3c85fe-80f5-4436-b097-a65d4578da8b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:37.965567 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0f3c85fe-80f5-4436-b097-a65d4578da8b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:38.164880 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0f3c85fe-80f5-4436-b097-a65d4578da8b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:38.174567 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0f3c85fe-80f5-4436-b097-a65d4578da8b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:38.176444 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0f3c85fe-80f5-4436-b097-a65d4578da8b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:38.177646 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0f3c85fe-80f5-4436-b097-a65d4578da8b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1744 microversion: 2.20 time: 0.225774 Apr 08 02:48:38.178277 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 151/292] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:37 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1744 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:38.841419 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-21a9bfc6-da31-43a0-b528-0d3287d6c6a5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:38.842024 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-21a9bfc6-da31-43a0-b528-0d3287d6c6a5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:38.851953 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-21a9bfc6-da31-43a0-b528-0d3287d6c6a5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:38.852392 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-21a9bfc6-da31-43a0-b528-0d3287d6c6a5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:38.853151 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-21a9bfc6-da31-43a0-b528-0d3287d6c6a5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:38.853578 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-21a9bfc6-da31-43a0-b528-0d3287d6c6a5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:39.038410 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3ef5b207-2273-46cf-8be5-506a8a34a3fc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Action: 'create', calling method: .version_select at 0x7fbc38748550>, body: {"keypair": {"name": "tempest-keypair-1247122313"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:48:39.053453 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-21a9bfc6-da31-43a0-b528-0d3287d6c6a5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:39.060269 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-3ef5b207-2273-46cf-8be5-506a8a34a3fc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'key_pairs'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:48:39.061917 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-21a9bfc6-da31-43a0-b528-0d3287d6c6a5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1721 microversion: 2.1 time: 0.224171 Apr 08 02:48:39.062795 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 142/293] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:38 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:39.064107 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-3ef5b207-2273-46cf-8be5-506a8a34a3fc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for user 44a64fb1ebd9411eb6156c8ef97c3072 and project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'key_pairs'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:48:39.196797 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ec23a3ed-6ac4-4c34-8cc9-654e906ad695 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:39.197883 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ec23a3ed-6ac4-4c34-8cc9-654e906ad695 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:39.209275 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ec23a3ed-6ac4-4c34-8cc9-654e906ad695 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:39.209790 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ec23a3ed-6ac4-4c34-8cc9-654e906ad695 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:39.210570 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ec23a3ed-6ac4-4c34-8cc9-654e906ad695 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:39.210998 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ec23a3ed-6ac4-4c34-8cc9-654e906ad695 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:39.234741 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-3ef5b207-2273-46cf-8be5-506a8a34a3fc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'key_pairs'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:48:39.239833 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-3ef5b207-2273-46cf-8be5-506a8a34a3fc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for user 44a64fb1ebd9411eb6156c8ef97c3072 and project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'key_pairs'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:48:39.253661 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3ef5b207-2273-46cf-8be5-506a8a34a3fc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.218815 Apr 08 02:48:39.254464 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 152/294] 10.222.0.23 () {60 vars in 1157 bytes} [Fri Apr 8 02:48:39 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:48:39.410914 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ec23a3ed-6ac4-4c34-8cc9-654e906ad695 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:39.419585 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ec23a3ed-6ac4-4c34-8cc9-654e906ad695 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:39.421178 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ec23a3ed-6ac4-4c34-8cc9-654e906ad695 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:39.422913 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ec23a3ed-6ac4-4c34-8cc9-654e906ad695 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1744 microversion: 2.20 time: 0.230655 Apr 08 02:48:39.423477 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 143/295] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:39 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1744 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:39.887199 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-16cda2ab-f7e7-4b3f-9965-2e81b0d649b0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:39.887694 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-16cda2ab-f7e7-4b3f-9965-2e81b0d649b0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:39.897149 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-16cda2ab-f7e7-4b3f-9965-2e81b0d649b0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:39.897594 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-16cda2ab-f7e7-4b3f-9965-2e81b0d649b0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:39.898354 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-16cda2ab-f7e7-4b3f-9965-2e81b0d649b0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:39.898786 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-16cda2ab-f7e7-4b3f-9965-2e81b0d649b0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:39.964137 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-16cda2ab-f7e7-4b3f-9965-2e81b0d649b0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Going to try to terminate instance {{(pid=101272) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:48:40.079200 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ecab70e3-1c0e-438e-a172-d65d04b271ee tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:40.079822 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ecab70e3-1c0e-438e-a172-d65d04b271ee tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:40.089563 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ecab70e3-1c0e-438e-a172-d65d04b271ee tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:40.090014 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ecab70e3-1c0e-438e-a172-d65d04b271ee tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:40.090913 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ecab70e3-1c0e-438e-a172-d65d04b271ee tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:40.091433 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ecab70e3-1c0e-438e-a172-d65d04b271ee tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:40.095109 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-16cda2ab-f7e7-4b3f-9965-2e81b0d649b0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 204 len: 0 microversion: 2.1 time: 0.211298 Apr 08 02:48:40.095806 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 153/296] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:48:39 2022] DELETE /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:48:40.105502 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-11f1c49b-ec4e-4b8d-84d7-abfab8ae9c1f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:40.106193 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-11f1c49b-ec4e-4b8d-84d7-abfab8ae9c1f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:40.115773 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-11f1c49b-ec4e-4b8d-84d7-abfab8ae9c1f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:40.116692 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-11f1c49b-ec4e-4b8d-84d7-abfab8ae9c1f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:40.117740 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-11f1c49b-ec4e-4b8d-84d7-abfab8ae9c1f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:40.118319 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-11f1c49b-ec4e-4b8d-84d7-abfab8ae9c1f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:40.325531 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-11f1c49b-ec4e-4b8d-84d7-abfab8ae9c1f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:40.334521 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-11f1c49b-ec4e-4b8d-84d7-abfab8ae9c1f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1515 microversion: 2.1 time: 0.233083 Apr 08 02:48:40.335232 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 154/297] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:40 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1515 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:40.339810 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-1069839d-ddfb-4475-b317-f37650dc9fbd req-4f9af68e-6690-4f86-893f-def8202c6a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a1344c-2d91-4224-ab68-1898d4aa8b0f", "name": "network-vif-plugged", "status": "completed", "tag": "19d6323f-cbfa-4743-8474-008e1a45beee"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:48:40.341379 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:48:40.341379 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:48:40.349520 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-1069839d-ddfb-4475-b317-f37650dc9fbd req-4f9af68e-6690-4f86-893f-def8202c6a6a service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:40.349960 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-1069839d-ddfb-4475-b317-f37650dc9fbd req-4f9af68e-6690-4f86-893f-def8202c6a6a service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:40.365810 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-1069839d-ddfb-4475-b317-f37650dc9fbd req-4f9af68e-6690-4f86-893f-def8202c6a6a service nova] Creating event network-vif-plugged:19d6323f-cbfa-4743-8474-008e1a45beee for instance 89a1344c-2d91-4224-ab68-1898d4aa8b0f on hv-cinder-83705 Apr 08 02:48:40.370489 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-1069839d-ddfb-4475-b317-f37650dc9fbd req-4f9af68e-6690-4f86-893f-def8202c6a6a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034160 Apr 08 02:48:40.371071 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 155/298] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:48:40.419056 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ecab70e3-1c0e-438e-a172-d65d04b271ee tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:40.428675 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ecab70e3-1c0e-438e-a172-d65d04b271ee tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1721 microversion: 2.1 time: 0.353873 Apr 08 02:48:40.429251 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 144/299] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:40 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1721 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:48:40.441393 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b7a80c3e-a31c-48ec-b114-0864b2f76095 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:40.442076 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b7a80c3e-a31c-48ec-b114-0864b2f76095 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:40.449772 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b7a80c3e-a31c-48ec-b114-0864b2f76095 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:40.450219 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b7a80c3e-a31c-48ec-b114-0864b2f76095 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:40.450989 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b7a80c3e-a31c-48ec-b114-0864b2f76095 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:40.451430 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b7a80c3e-a31c-48ec-b114-0864b2f76095 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:40.653287 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b7a80c3e-a31c-48ec-b114-0864b2f76095 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:40.662479 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b7a80c3e-a31c-48ec-b114-0864b2f76095 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:40.664045 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b7a80c3e-a31c-48ec-b114-0864b2f76095 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:40.665175 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b7a80c3e-a31c-48ec-b114-0864b2f76095 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1744 microversion: 2.20 time: 0.228158 Apr 08 02:48:40.665916 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 156/300] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:40 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1744 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:41.067116 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2116bfb4-0c3c-438b-88e5-326b1c2ba3c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-84426995", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43b1983b-07c7-47cb-8ae4-f6d4398035b6"}], "security_groups": [{"name": "tempest-securitygroup--361284826"}], "key_name": "tempest-keypair-1247122313", "user_data": "}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:48:41.175236 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.network.neutron [None req-2116bfb4-0c3c-438b-88e5-326b1c2ba3c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] validate_networks() for [('43b1983b-07c7-47cb-8ae4-f6d4398035b6', None, None, None)] {{(pid=101271) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:48:41.352258 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0afefe84-fad8-42b0-a53d-f4a7915b59aa tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:41.352875 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0afefe84-fad8-42b0-a53d-f4a7915b59aa tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:41.360665 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0afefe84-fad8-42b0-a53d-f4a7915b59aa tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:41.361124 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0afefe84-fad8-42b0-a53d-f4a7915b59aa tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:41.361892 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0afefe84-fad8-42b0-a53d-f4a7915b59aa tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:41.362330 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0afefe84-fad8-42b0-a53d-f4a7915b59aa tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:41.560863 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0afefe84-fad8-42b0-a53d-f4a7915b59aa tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:41.569950 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0afefe84-fad8-42b0-a53d-f4a7915b59aa tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1515 microversion: 2.1 time: 0.221406 Apr 08 02:48:41.570528 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 157/301] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:41 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:48:41.574787 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e026747f-8346-473e-a0db-aefc12320cb5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:41.575396 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e026747f-8346-473e-a0db-aefc12320cb5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:41.582608 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e026747f-8346-473e-a0db-aefc12320cb5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:41.583061 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e026747f-8346-473e-a0db-aefc12320cb5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:41.583830 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e026747f-8346-473e-a0db-aefc12320cb5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:41.584294 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e026747f-8346-473e-a0db-aefc12320cb5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:41.695607 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-2116bfb4-0c3c-438b-88e5-326b1c2ba3c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Flavor limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:48:41.696050 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-2116bfb4-0c3c-438b-88e5-326b1c2ba3c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Image limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:48:41.696521 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-2116bfb4-0c3c-438b-88e5-326b1c2ba3c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Flavor pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:48:41.696925 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-2116bfb4-0c3c-438b-88e5-326b1c2ba3c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Image pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:48:41.697329 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-2116bfb4-0c3c-438b-88e5-326b1c2ba3c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:48:41.706576 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2116bfb4-0c3c-438b-88e5-326b1c2ba3c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:41.707009 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2116bfb4-0c3c-438b-88e5-326b1c2ba3c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:41.707797 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2116bfb4-0c3c-438b-88e5-326b1c2ba3c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:41.708260 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2116bfb4-0c3c-438b-88e5-326b1c2ba3c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:41.726026 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-2116bfb4-0c3c-438b-88e5-326b1c2ba3c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:48:41.729871 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-2116bfb4-0c3c-438b-88e5-326b1c2ba3c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for user 44a64fb1ebd9411eb6156c8ef97c3072 and project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:48:41.740321 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2116bfb4-0c3c-438b-88e5-326b1c2ba3c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Going to run 1 instances... {{(pid=101271) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:48:41.742627 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2116bfb4-0c3c-438b-88e5-326b1c2ba3c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:48:41.781967 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e026747f-8346-473e-a0db-aefc12320cb5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:41.791294 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e026747f-8346-473e-a0db-aefc12320cb5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1721 microversion: 2.1 time: 0.219758 Apr 08 02:48:41.791478 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2116bfb4-0c3c-438b-88e5-326b1c2ba3c3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.728291 Apr 08 02:48:41.801865 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 158/302] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:41 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:41.802034 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 145/303] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:48:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:48:41.805049 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d40e1afa-f8a1-4494-89c6-cfa5cf0917dd tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:41.805939 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d40e1afa-f8a1-4494-89c6-cfa5cf0917dd tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:41.806390 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ff435b3b-449c-48b7-81e0-746ea9998463 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:41.807733 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ff435b3b-449c-48b7-81e0-746ea9998463 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:41.814045 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d40e1afa-f8a1-4494-89c6-cfa5cf0917dd tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:41.814499 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d40e1afa-f8a1-4494-89c6-cfa5cf0917dd tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:41.815270 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d40e1afa-f8a1-4494-89c6-cfa5cf0917dd tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:41.815887 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d40e1afa-f8a1-4494-89c6-cfa5cf0917dd tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:41.884552 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ff435b3b-449c-48b7-81e0-746ea9998463 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:41.898600 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ff435b3b-449c-48b7-81e0-746ea9998463 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1240 microversion: 2.1 time: 0.095661 Apr 08 02:48:41.899214 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 146/304] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:41 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1240 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:42.023556 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d40e1afa-f8a1-4494-89c6-cfa5cf0917dd tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:42.033480 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d40e1afa-f8a1-4494-89c6-cfa5cf0917dd tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:42.035179 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d40e1afa-f8a1-4494-89c6-cfa5cf0917dd tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:42.036381 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d40e1afa-f8a1-4494-89c6-cfa5cf0917dd tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1744 microversion: 2.20 time: 0.243199 Apr 08 02:48:42.037132 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 159/305] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:41 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1744 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:42.587306 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ea725a00-ba77-4141-9a1f-8d0ad75ed813 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:42.588193 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ea725a00-ba77-4141-9a1f-8d0ad75ed813 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:42.597473 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ea725a00-ba77-4141-9a1f-8d0ad75ed813 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:42.597920 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ea725a00-ba77-4141-9a1f-8d0ad75ed813 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:42.598700 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ea725a00-ba77-4141-9a1f-8d0ad75ed813 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:42.599137 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ea725a00-ba77-4141-9a1f-8d0ad75ed813 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:42.792927 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ea725a00-ba77-4141-9a1f-8d0ad75ed813 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:42.801405 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ea725a00-ba77-4141-9a1f-8d0ad75ed813 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1515 microversion: 2.1 time: 0.218277 Apr 08 02:48:42.801951 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 147/306] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:42 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:42.808632 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-55519a69-e14e-4edf-8769-120b9d5bff94 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:42.809235 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-55519a69-e14e-4edf-8769-120b9d5bff94 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:42.818413 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-55519a69-e14e-4edf-8769-120b9d5bff94 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:42.818855 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-55519a69-e14e-4edf-8769-120b9d5bff94 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:42.819616 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-55519a69-e14e-4edf-8769-120b9d5bff94 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:42.820126 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-55519a69-e14e-4edf-8769-120b9d5bff94 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:42.917865 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b679e16e-7e9c-4f8d-a17a-73b8ba397e66 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:42.918585 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b679e16e-7e9c-4f8d-a17a-73b8ba397e66 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:42.934868 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b679e16e-7e9c-4f8d-a17a-73b8ba397e66 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:42.935510 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b679e16e-7e9c-4f8d-a17a-73b8ba397e66 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:42.936552 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b679e16e-7e9c-4f8d-a17a-73b8ba397e66 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:42.938395 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b679e16e-7e9c-4f8d-a17a-73b8ba397e66 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:43.098870 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b679e16e-7e9c-4f8d-a17a-73b8ba397e66 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:43.122520 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b679e16e-7e9c-4f8d-a17a-73b8ba397e66 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1300 microversion: 2.1 time: 0.209020 Apr 08 02:48:43.123139 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 148/307] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:42 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1300 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:43.127725 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1471669c-c22d-4d2f-9525-fc4534a9aa98 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:43.132299 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1471669c-c22d-4d2f-9525-fc4534a9aa98 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:43.144841 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1471669c-c22d-4d2f-9525-fc4534a9aa98 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:43.145290 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1471669c-c22d-4d2f-9525-fc4534a9aa98 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:43.146100 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1471669c-c22d-4d2f-9525-fc4534a9aa98 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:43.146606 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1471669c-c22d-4d2f-9525-fc4534a9aa98 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:43.336686 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-55519a69-e14e-4edf-8769-120b9d5bff94 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:43.347305 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-55519a69-e14e-4edf-8769-120b9d5bff94 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1698 microversion: 2.1 time: 0.542179 Apr 08 02:48:43.356151 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 160/308] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:42 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1698 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:43.364304 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b7f7d9d8-590e-4781-af7e-19a0f808aa77 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:48:43.372678 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b7f7d9d8-590e-4781-af7e-19a0f808aa77 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:43.373270 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b7f7d9d8-590e-4781-af7e-19a0f808aa77 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:43.444571 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1471669c-c22d-4d2f-9525-fc4534a9aa98 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:43.454368 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1471669c-c22d-4d2f-9525-fc4534a9aa98 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:43.455866 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1471669c-c22d-4d2f-9525-fc4534a9aa98 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:43.457033 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1471669c-c22d-4d2f-9525-fc4534a9aa98 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1744 microversion: 2.20 time: 0.332954 Apr 08 02:48:43.457786 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 149/309] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:43 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1744 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:43.480507 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b7f7d9d8-590e-4781-af7e-19a0f808aa77 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Going to try to start instance {{(pid=101272) start /opt/stack/nova/nova/compute/api.py:2625}} Apr 08 02:48:43.531392 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-07f11b1c-f105-48da-89d9-33d1336672fe req-9a98c3e3-5192-4a68-8421-757d2703623c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe", "name": "network-vif-deleted", "tag": "14d1b36d-6c01-4e8d-a401-29ca0ecd841c"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:48:43.533456 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:48:43.533456 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:48:43.541775 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-07f11b1c-f105-48da-89d9-33d1336672fe req-9a98c3e3-5192-4a68-8421-757d2703623c service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:43.542433 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-07f11b1c-f105-48da-89d9-33d1336672fe req-9a98c3e3-5192-4a68-8421-757d2703623c service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:43.559296 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-07f11b1c-f105-48da-89d9-33d1336672fe req-9a98c3e3-5192-4a68-8421-757d2703623c service nova] Creating event network-vif-deleted:14d1b36d-6c01-4e8d-a401-29ca0ecd841c for instance 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe on hv-cinder-83705 Apr 08 02:48:43.565003 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-07f11b1c-f105-48da-89d9-33d1336672fe req-9a98c3e3-5192-4a68-8421-757d2703623c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039803 Apr 08 02:48:43.565586 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 150/310] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:48:43.568632 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b7f7d9d8-590e-4781-af7e-19a0f808aa77 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "POST /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/action" status: 202 len: 0 microversion: 2.1 time: 0.208410 Apr 08 02:48:43.569221 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 161/311] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Apr 8 02:48:43 2022] POST /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 02:48:43.577492 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8ffe20ba-4744-4c4a-974e-cf0ea451bc90 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:43.578207 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-8ffe20ba-4744-4c4a-974e-cf0ea451bc90 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:43.585684 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8ffe20ba-4744-4c4a-974e-cf0ea451bc90 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:43.586132 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8ffe20ba-4744-4c4a-974e-cf0ea451bc90 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:43.586895 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8ffe20ba-4744-4c4a-974e-cf0ea451bc90 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:43.587330 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8ffe20ba-4744-4c4a-974e-cf0ea451bc90 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:43.823307 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-30aaf687-c0d5-43ae-94eb-34dc4f6afc0b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:43.825050 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-30aaf687-c0d5-43ae-94eb-34dc4f6afc0b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:43.834906 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-30aaf687-c0d5-43ae-94eb-34dc4f6afc0b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:43.836955 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-30aaf687-c0d5-43ae-94eb-34dc4f6afc0b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:43.837238 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-30aaf687-c0d5-43ae-94eb-34dc4f6afc0b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:43.837876 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-30aaf687-c0d5-43ae-94eb-34dc4f6afc0b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:43.912941 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-30aaf687-c0d5-43ae-94eb-34dc4f6afc0b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:43.913472 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-30aaf687-c0d5-43ae-94eb-34dc4f6afc0b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:43.914110 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.objects.instance [None req-30aaf687-c0d5-43ae-94eb-34dc4f6afc0b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lazy-loading 'fault' on Instance uuid 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe {{(pid=101272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:48:43.931649 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-8ffe20ba-4744-4c4a-974e-cf0ea451bc90 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:43.944425 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8ffe20ba-4744-4c4a-974e-cf0ea451bc90 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1707 microversion: 2.1 time: 0.370804 Apr 08 02:48:43.956053 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 151/312] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:43 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1707 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:44.032580 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-30aaf687-c0d5-43ae-94eb-34dc4f6afc0b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:44.047522 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-30aaf687-c0d5-43ae-94eb-34dc4f6afc0b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 200 len: 1309 microversion: 2.1 time: 0.230656 Apr 08 02:48:44.049087 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 162/313] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:43 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 1309 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:44.141984 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f348fe13-623d-4329-ba2c-913580b1cb9c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:44.143081 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f348fe13-623d-4329-ba2c-913580b1cb9c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:44.154887 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f348fe13-623d-4329-ba2c-913580b1cb9c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:44.155726 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f348fe13-623d-4329-ba2c-913580b1cb9c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:44.156911 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f348fe13-623d-4329-ba2c-913580b1cb9c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:44.157562 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f348fe13-623d-4329-ba2c-913580b1cb9c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:44.313538 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f348fe13-623d-4329-ba2c-913580b1cb9c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:44.329548 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f348fe13-623d-4329-ba2c-913580b1cb9c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1298 microversion: 2.1 time: 0.190439 Apr 08 02:48:44.330205 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 152/314] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:44 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1298 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:44.474406 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-6663da68-539d-4797-ae6f-4ba31b7f6e17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:44.475267 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-6663da68-539d-4797-ae6f-4ba31b7f6e17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:44.482996 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6663da68-539d-4797-ae6f-4ba31b7f6e17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:44.483431 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6663da68-539d-4797-ae6f-4ba31b7f6e17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:44.485032 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6663da68-539d-4797-ae6f-4ba31b7f6e17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:44.485617 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6663da68-539d-4797-ae6f-4ba31b7f6e17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:44.903392 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-6663da68-539d-4797-ae6f-4ba31b7f6e17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:44.914847 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-6663da68-539d-4797-ae6f-4ba31b7f6e17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:44.916664 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-6663da68-539d-4797-ae6f-4ba31b7f6e17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:44.920245 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-6663da68-539d-4797-ae6f-4ba31b7f6e17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1739 microversion: 2.20 time: 0.449332 Apr 08 02:48:44.921346 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 163/315] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:44 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1739 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:44.962314 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-7872e125-f28a-4ddf-953b-d2da20b7ae25 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:44.963772 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-7872e125-f28a-4ddf-953b-d2da20b7ae25 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:44.985883 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7872e125-f28a-4ddf-953b-d2da20b7ae25 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:44.986927 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7872e125-f28a-4ddf-953b-d2da20b7ae25 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:44.990187 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7872e125-f28a-4ddf-953b-d2da20b7ae25 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:44.990924 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7872e125-f28a-4ddf-953b-d2da20b7ae25 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:45.065749 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e1405619-e3d1-4b68-beb1-fc90026be485 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:45.066361 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e1405619-e3d1-4b68-beb1-fc90026be485 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:45.087447 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e1405619-e3d1-4b68-beb1-fc90026be485 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:45.087897 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e1405619-e3d1-4b68-beb1-fc90026be485 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:45.088734 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e1405619-e3d1-4b68-beb1-fc90026be485 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:45.089171 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e1405619-e3d1-4b68-beb1-fc90026be485 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:45.178583 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-e1405619-e3d1-4b68-beb1-fc90026be485 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] HTTP exception thrown: Instance 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe could not be found. Apr 08 02:48:45.179188 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e1405619-e3d1-4b68-beb1-fc90026be485 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Returning 404 to user: Instance 1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:48:45.180044 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e1405619-e3d1-4b68-beb1-fc90026be485 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe" status: 404 len: 111 microversion: 2.1 time: 0.118261 Apr 08 02:48:45.180601 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 164/316] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:45 2022] GET /compute/v2.1/servers/1ebdd16e-baa0-4722-ba91-1e4bb99c9ffe => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:48:45.351437 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-80094f31-d879-48af-9e2d-b902e33fe182 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:45.352235 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-80094f31-d879-48af-9e2d-b902e33fe182 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:45.366105 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-80094f31-d879-48af-9e2d-b902e33fe182 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:45.368080 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-80094f31-d879-48af-9e2d-b902e33fe182 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:45.370294 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-80094f31-d879-48af-9e2d-b902e33fe182 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:45.373636 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-80094f31-d879-48af-9e2d-b902e33fe182 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:45.424816 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-7872e125-f28a-4ddf-953b-d2da20b7ae25 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:45.435895 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-7872e125-f28a-4ddf-953b-d2da20b7ae25 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1707 microversion: 2.1 time: 0.477102 Apr 08 02:48:45.437748 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 153/317] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:44 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1707 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:45.712036 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-80094f31-d879-48af-9e2d-b902e33fe182 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:45.724815 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-80094f31-d879-48af-9e2d-b902e33fe182 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1365 microversion: 2.1 time: 0.380306 Apr 08 02:48:45.735379 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 165/318] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:45 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1365 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:45.939650 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-36220c73-c2ff-4396-bff9-b9b0fb180526 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:45.940606 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-36220c73-c2ff-4396-bff9-b9b0fb180526 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:45.950553 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-36220c73-c2ff-4396-bff9-b9b0fb180526 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:45.950969 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-36220c73-c2ff-4396-bff9-b9b0fb180526 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:45.951757 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-36220c73-c2ff-4396-bff9-b9b0fb180526 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:45.952281 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-36220c73-c2ff-4396-bff9-b9b0fb180526 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:46.005276 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-4f1f9f44-a424-4bc5-aa93-f072c98f2307 req-4d2a4910-a278-4ff9-9479-6a8d15682ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df7f7249-30e7-40a1-9854-881972b2ed1a", "tag": "666035a5-39af-4115-b103-73d896c88814"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:48:46.007647 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:48:46.007647 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:48:46.024736 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-4f1f9f44-a424-4bc5-aa93-f072c98f2307 req-4d2a4910-a278-4ff9-9479-6a8d15682ad3 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:46.025180 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-4f1f9f44-a424-4bc5-aa93-f072c98f2307 req-4d2a4910-a278-4ff9-9479-6a8d15682ad3 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:46.077110 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-4f1f9f44-a424-4bc5-aa93-f072c98f2307 req-4d2a4910-a278-4ff9-9479-6a8d15682ad3 service nova] Creating event network-changed:666035a5-39af-4115-b103-73d896c88814 for instance df7f7249-30e7-40a1-9854-881972b2ed1a on hv-cinder-83705 Apr 08 02:48:46.095517 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-4f1f9f44-a424-4bc5-aa93-f072c98f2307 req-4d2a4910-a278-4ff9-9479-6a8d15682ad3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098508 Apr 08 02:48:46.098583 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 166/319] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:48:46.259658 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-36220c73-c2ff-4396-bff9-b9b0fb180526 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:46.272732 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-36220c73-c2ff-4396-bff9-b9b0fb180526 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:46.274389 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-36220c73-c2ff-4396-bff9-b9b0fb180526 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:46.276768 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-36220c73-c2ff-4396-bff9-b9b0fb180526 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1739 microversion: 2.20 time: 0.340634 Apr 08 02:48:46.278517 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 154/320] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:45 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1739 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:46.456432 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-909a8729-9b70-486e-9a4f-40549291e670 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:46.457389 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-909a8729-9b70-486e-9a4f-40549291e670 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:46.466060 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-909a8729-9b70-486e-9a4f-40549291e670 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:46.466711 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-909a8729-9b70-486e-9a4f-40549291e670 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:46.467636 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-909a8729-9b70-486e-9a4f-40549291e670 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:46.468302 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-909a8729-9b70-486e-9a4f-40549291e670 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:46.720850 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-909a8729-9b70-486e-9a4f-40549291e670 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:46.729556 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-909a8729-9b70-486e-9a4f-40549291e670 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1711 microversion: 2.1 time: 0.277893 Apr 08 02:48:46.730110 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 167/321] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:46 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1711 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:46.743437 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e322d18b-92a3-4b43-b587-2a590c2d05e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:46.744073 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e322d18b-92a3-4b43-b587-2a590c2d05e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:46.752236 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e322d18b-92a3-4b43-b587-2a590c2d05e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:46.752794 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e322d18b-92a3-4b43-b587-2a590c2d05e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:46.753666 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e322d18b-92a3-4b43-b587-2a590c2d05e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:46.754170 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e322d18b-92a3-4b43-b587-2a590c2d05e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:47.015904 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e322d18b-92a3-4b43-b587-2a590c2d05e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:47.024496 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e322d18b-92a3-4b43-b587-2a590c2d05e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1365 microversion: 2.1 time: 0.285418 Apr 08 02:48:47.034918 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 155/322] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:46 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:47.294859 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-bbe36c09-7cfd-4611-af48-ae56b9f1a218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:47.295393 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-bbe36c09-7cfd-4611-af48-ae56b9f1a218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:47.306035 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bbe36c09-7cfd-4611-af48-ae56b9f1a218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:47.306479 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bbe36c09-7cfd-4611-af48-ae56b9f1a218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:47.307248 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bbe36c09-7cfd-4611-af48-ae56b9f1a218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:47.307669 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bbe36c09-7cfd-4611-af48-ae56b9f1a218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:47.643118 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-bbe36c09-7cfd-4611-af48-ae56b9f1a218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:47.654752 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-bbe36c09-7cfd-4611-af48-ae56b9f1a218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:47.658417 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-bbe36c09-7cfd-4611-af48-ae56b9f1a218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:47.660769 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-bbe36c09-7cfd-4611-af48-ae56b9f1a218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1739 microversion: 2.20 time: 0.369411 Apr 08 02:48:47.662280 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 168/323] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:47 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1739 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:48.041505 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-226cdaf1-6f17-4fed-8931-2fddc90087df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:48.042844 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-226cdaf1-6f17-4fed-8931-2fddc90087df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:48.055502 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-226cdaf1-6f17-4fed-8931-2fddc90087df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:48.056249 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-226cdaf1-6f17-4fed-8931-2fddc90087df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:48.057030 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-226cdaf1-6f17-4fed-8931-2fddc90087df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:48.057464 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-226cdaf1-6f17-4fed-8931-2fddc90087df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:48.305084 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-226cdaf1-6f17-4fed-8931-2fddc90087df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:48.313702 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-226cdaf1-6f17-4fed-8931-2fddc90087df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1365 microversion: 2.1 time: 0.275957 Apr 08 02:48:48.314266 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 156/324] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:48 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1365 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:48.684417 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b7f1ca67-253c-4880-9e32-8fbb6cb1a62a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:48.685006 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b7f1ca67-253c-4880-9e32-8fbb6cb1a62a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:48.694935 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b7f1ca67-253c-4880-9e32-8fbb6cb1a62a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:48.696055 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b7f1ca67-253c-4880-9e32-8fbb6cb1a62a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:48.697012 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b7f1ca67-253c-4880-9e32-8fbb6cb1a62a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:48.697600 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b7f1ca67-253c-4880-9e32-8fbb6cb1a62a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:49.164069 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b7f1ca67-253c-4880-9e32-8fbb6cb1a62a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:49.173639 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b7f1ca67-253c-4880-9e32-8fbb6cb1a62a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:49.175212 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b7f1ca67-253c-4880-9e32-8fbb6cb1a62a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:49.176638 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b7f1ca67-253c-4880-9e32-8fbb6cb1a62a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1739 microversion: 2.20 time: 0.495723 Apr 08 02:48:49.177611 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 169/325] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:48 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1739 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:49.330428 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c81bf877-e16e-4b99-820a-ec86d427bdf8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:49.331776 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c81bf877-e16e-4b99-820a-ec86d427bdf8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:49.339532 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c81bf877-e16e-4b99-820a-ec86d427bdf8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:49.340387 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c81bf877-e16e-4b99-820a-ec86d427bdf8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:49.341361 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c81bf877-e16e-4b99-820a-ec86d427bdf8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:49.342017 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c81bf877-e16e-4b99-820a-ec86d427bdf8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:49.652939 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c81bf877-e16e-4b99-820a-ec86d427bdf8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:49.666335 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c81bf877-e16e-4b99-820a-ec86d427bdf8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1365 microversion: 2.1 time: 0.339785 Apr 08 02:48:49.667083 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 157/326] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:49 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:50.196764 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-563bfeff-79b5-4d7c-9a80-cf6e4072b4ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:50.198505 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-563bfeff-79b5-4d7c-9a80-cf6e4072b4ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:50.207324 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-563bfeff-79b5-4d7c-9a80-cf6e4072b4ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:50.207758 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-563bfeff-79b5-4d7c-9a80-cf6e4072b4ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:50.208570 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-563bfeff-79b5-4d7c-9a80-cf6e4072b4ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:50.209001 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-563bfeff-79b5-4d7c-9a80-cf6e4072b4ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:50.536441 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-563bfeff-79b5-4d7c-9a80-cf6e4072b4ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:50.545239 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-563bfeff-79b5-4d7c-9a80-cf6e4072b4ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:50.546998 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-563bfeff-79b5-4d7c-9a80-cf6e4072b4ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:50.548173 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-563bfeff-79b5-4d7c-9a80-cf6e4072b4ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1739 microversion: 2.20 time: 0.355649 Apr 08 02:48:50.548728 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 170/327] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:50 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1739 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:50.686149 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-6fc87f5b-0885-4206-833e-b0a72038f4de tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:50.688312 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-6fc87f5b-0885-4206-833e-b0a72038f4de tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:50.695901 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6fc87f5b-0885-4206-833e-b0a72038f4de tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:50.696371 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6fc87f5b-0885-4206-833e-b0a72038f4de tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:50.697135 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6fc87f5b-0885-4206-833e-b0a72038f4de tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:50.697561 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6fc87f5b-0885-4206-833e-b0a72038f4de tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:50.999904 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-6fc87f5b-0885-4206-833e-b0a72038f4de tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:51.012540 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-6fc87f5b-0885-4206-833e-b0a72038f4de tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1365 microversion: 2.1 time: 0.330032 Apr 08 02:48:51.013355 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 158/328] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:50 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:51.571963 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4f63b36f-bb7f-47bf-a44e-a2443a062890 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:51.574027 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4f63b36f-bb7f-47bf-a44e-a2443a062890 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:51.582881 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4f63b36f-bb7f-47bf-a44e-a2443a062890 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:51.583799 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4f63b36f-bb7f-47bf-a44e-a2443a062890 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:51.584691 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4f63b36f-bb7f-47bf-a44e-a2443a062890 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:51.585191 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4f63b36f-bb7f-47bf-a44e-a2443a062890 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:51.801675 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4f63b36f-bb7f-47bf-a44e-a2443a062890 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:51.811303 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4f63b36f-bb7f-47bf-a44e-a2443a062890 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:51.814185 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4f63b36f-bb7f-47bf-a44e-a2443a062890 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:51.815410 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-4f63b36f-bb7f-47bf-a44e-a2443a062890 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1739 microversion: 2.20 time: 0.247391 Apr 08 02:48:51.815974 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 171/329] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:51 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:52.029784 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a2b4c229-85c9-40f5-aefb-8aac79b9efa4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:52.031225 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a2b4c229-85c9-40f5-aefb-8aac79b9efa4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:52.041015 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a2b4c229-85c9-40f5-aefb-8aac79b9efa4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:52.041772 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a2b4c229-85c9-40f5-aefb-8aac79b9efa4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:52.042620 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a2b4c229-85c9-40f5-aefb-8aac79b9efa4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:52.043274 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a2b4c229-85c9-40f5-aefb-8aac79b9efa4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:52.368904 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a2b4c229-85c9-40f5-aefb-8aac79b9efa4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:52.378969 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a2b4c229-85c9-40f5-aefb-8aac79b9efa4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1365 microversion: 2.1 time: 0.353246 Apr 08 02:48:52.380107 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 159/330] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:52 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1365 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:52.833600 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4d3027dc-cba3-4a64-8276-4c3c889e5354 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:52.835512 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4d3027dc-cba3-4a64-8276-4c3c889e5354 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:52.844677 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4d3027dc-cba3-4a64-8276-4c3c889e5354 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:52.845377 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4d3027dc-cba3-4a64-8276-4c3c889e5354 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:52.846194 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4d3027dc-cba3-4a64-8276-4c3c889e5354 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:52.846636 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4d3027dc-cba3-4a64-8276-4c3c889e5354 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:53.080731 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4d3027dc-cba3-4a64-8276-4c3c889e5354 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:53.090006 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4d3027dc-cba3-4a64-8276-4c3c889e5354 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:53.091720 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4d3027dc-cba3-4a64-8276-4c3c889e5354 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:53.093599 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-4d3027dc-cba3-4a64-8276-4c3c889e5354 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1739 microversion: 2.20 time: 0.263162 Apr 08 02:48:53.094670 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 172/331] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:52 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:53.398075 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-bffe4c59-7c14-4488-9e82-d8b6f5114153 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:53.398609 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-bffe4c59-7c14-4488-9e82-d8b6f5114153 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:53.406387 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-bffe4c59-7c14-4488-9e82-d8b6f5114153 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:53.407047 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-bffe4c59-7c14-4488-9e82-d8b6f5114153 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:53.408062 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-bffe4c59-7c14-4488-9e82-d8b6f5114153 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:53.408493 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-bffe4c59-7c14-4488-9e82-d8b6f5114153 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:53.631747 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-bffe4c59-7c14-4488-9e82-d8b6f5114153 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:53.640721 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-bffe4c59-7c14-4488-9e82-d8b6f5114153 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1365 microversion: 2.1 time: 0.247285 Apr 08 02:48:53.641282 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 160/332] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:53 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:54.113226 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-cb2a09dd-7839-4b02-ad72-dfd07c68abac tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:54.113826 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-cb2a09dd-7839-4b02-ad72-dfd07c68abac tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:54.122079 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cb2a09dd-7839-4b02-ad72-dfd07c68abac tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:54.123113 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cb2a09dd-7839-4b02-ad72-dfd07c68abac tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:54.125408 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cb2a09dd-7839-4b02-ad72-dfd07c68abac tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:54.125915 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cb2a09dd-7839-4b02-ad72-dfd07c68abac tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:54.368792 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cb2a09dd-7839-4b02-ad72-dfd07c68abac tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:54.378456 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cb2a09dd-7839-4b02-ad72-dfd07c68abac tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:54.379993 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cb2a09dd-7839-4b02-ad72-dfd07c68abac tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:54.381266 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-cb2a09dd-7839-4b02-ad72-dfd07c68abac tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1739 microversion: 2.20 time: 0.272449 Apr 08 02:48:54.393022 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 173/333] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:54 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:54.657310 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-cd4162cf-7557-4e4a-ba81-275e8a70f7bd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:54.657928 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-cd4162cf-7557-4e4a-ba81-275e8a70f7bd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:54.666038 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cd4162cf-7557-4e4a-ba81-275e8a70f7bd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:54.666482 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cd4162cf-7557-4e4a-ba81-275e8a70f7bd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:54.667361 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cd4162cf-7557-4e4a-ba81-275e8a70f7bd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:54.667793 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cd4162cf-7557-4e4a-ba81-275e8a70f7bd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:54.877364 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-cd4162cf-7557-4e4a-ba81-275e8a70f7bd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:54.888494 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-cd4162cf-7557-4e4a-ba81-275e8a70f7bd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1365 microversion: 2.1 time: 0.235217 Apr 08 02:48:54.898498 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 161/334] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:54 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:55.400552 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2b3275f7-6d2c-4ef8-91fb-7775fb2dd805 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:55.401359 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2b3275f7-6d2c-4ef8-91fb-7775fb2dd805 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:55.409150 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2b3275f7-6d2c-4ef8-91fb-7775fb2dd805 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:55.409703 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2b3275f7-6d2c-4ef8-91fb-7775fb2dd805 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:55.410551 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2b3275f7-6d2c-4ef8-91fb-7775fb2dd805 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:55.411169 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2b3275f7-6d2c-4ef8-91fb-7775fb2dd805 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:55.631842 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2b3275f7-6d2c-4ef8-91fb-7775fb2dd805 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:55.641014 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2b3275f7-6d2c-4ef8-91fb-7775fb2dd805 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:55.642528 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2b3275f7-6d2c-4ef8-91fb-7775fb2dd805 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:55.643654 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2b3275f7-6d2c-4ef8-91fb-7775fb2dd805 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1739 microversion: 2.20 time: 0.246887 Apr 08 02:48:55.644249 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 174/335] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:55 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:55.905237 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-18b80ac8-d9a5-4a82-b16a-363083ba0b6c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:55.906396 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-18b80ac8-d9a5-4a82-b16a-363083ba0b6c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:55.913675 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-18b80ac8-d9a5-4a82-b16a-363083ba0b6c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:55.914124 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-18b80ac8-d9a5-4a82-b16a-363083ba0b6c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:55.914913 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-18b80ac8-d9a5-4a82-b16a-363083ba0b6c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:55.915348 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-18b80ac8-d9a5-4a82-b16a-363083ba0b6c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:56.112049 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-18b80ac8-d9a5-4a82-b16a-363083ba0b6c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:56.120036 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-18b80ac8-d9a5-4a82-b16a-363083ba0b6c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1365 microversion: 2.1 time: 0.218434 Apr 08 02:48:56.120601 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 162/336] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:55 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:56.661506 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-65efa638-cad4-41c3-b91e-833d541f22dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:56.662115 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-65efa638-cad4-41c3-b91e-833d541f22dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:56.669414 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-65efa638-cad4-41c3-b91e-833d541f22dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:56.669860 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-65efa638-cad4-41c3-b91e-833d541f22dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:56.670616 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-65efa638-cad4-41c3-b91e-833d541f22dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:56.671556 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-65efa638-cad4-41c3-b91e-833d541f22dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:56.860731 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-65efa638-cad4-41c3-b91e-833d541f22dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:56.869262 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-65efa638-cad4-41c3-b91e-833d541f22dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:56.870760 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-65efa638-cad4-41c3-b91e-833d541f22dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:56.871877 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-65efa638-cad4-41c3-b91e-833d541f22dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1739 microversion: 2.20 time: 0.214052 Apr 08 02:48:56.872457 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 175/337] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:56 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:57.137233 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b4a9404f-2430-43f3-88cd-6912018f2422 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:57.137838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b4a9404f-2430-43f3-88cd-6912018f2422 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:57.145676 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b4a9404f-2430-43f3-88cd-6912018f2422 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:57.146118 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b4a9404f-2430-43f3-88cd-6912018f2422 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:57.146902 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b4a9404f-2430-43f3-88cd-6912018f2422 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:57.147335 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b4a9404f-2430-43f3-88cd-6912018f2422 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:57.340503 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b4a9404f-2430-43f3-88cd-6912018f2422 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:57.349249 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b4a9404f-2430-43f3-88cd-6912018f2422 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1365 microversion: 2.1 time: 0.215964 Apr 08 02:48:57.349802 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 163/338] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:57 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:57.875813 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-349af027-16fa-425f-a804-3f5b7781f91b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1178752705", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452", "networks": [{"uuid": "82e858b5-a7a6-4321-935a-f5708e9fb4a1"}]}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:48:57.890167 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e782cecb-a552-47c1-8e90-cd99dfb1cedf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:57.890772 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e782cecb-a552-47c1-8e90-cd99dfb1cedf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:57.899161 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e782cecb-a552-47c1-8e90-cd99dfb1cedf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:57.899623 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e782cecb-a552-47c1-8e90-cd99dfb1cedf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:57.900409 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e782cecb-a552-47c1-8e90-cd99dfb1cedf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:57.900840 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e782cecb-a552-47c1-8e90-cd99dfb1cedf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:57.945207 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.network.neutron [None req-349af027-16fa-425f-a804-3f5b7781f91b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] validate_networks() for [('82e858b5-a7a6-4321-935a-f5708e9fb4a1', None, None, None)] {{(pid=101272) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:48:58.247016 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e782cecb-a552-47c1-8e90-cd99dfb1cedf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:58.256394 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e782cecb-a552-47c1-8e90-cd99dfb1cedf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:58.257985 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e782cecb-a552-47c1-8e90-cd99dfb1cedf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:58.259308 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e782cecb-a552-47c1-8e90-cd99dfb1cedf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1721 microversion: 2.20 time: 0.372882 Apr 08 02:48:58.260294 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 164/339] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:57 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1721 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:48:58.366977 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-84953950-c446-461b-a3c4-f4166e590f9a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:58.367500 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-84953950-c446-461b-a3c4-f4166e590f9a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:58.374746 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-84953950-c446-461b-a3c4-f4166e590f9a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:58.375197 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-84953950-c446-461b-a3c4-f4166e590f9a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:58.375988 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-84953950-c446-461b-a3c4-f4166e590f9a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:58.376423 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-84953950-c446-461b-a3c4-f4166e590f9a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:58.489242 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-349af027-16fa-425f-a804-3f5b7781f91b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Flavor limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:48:58.490099 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-349af027-16fa-425f-a804-3f5b7781f91b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Image limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:48:58.490809 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-349af027-16fa-425f-a804-3f5b7781f91b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Flavor pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:48:58.491461 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-349af027-16fa-425f-a804-3f5b7781f91b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Image pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:48:58.492320 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-349af027-16fa-425f-a804-3f5b7781f91b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:48:58.503742 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-349af027-16fa-425f-a804-3f5b7781f91b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:58.504929 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-349af027-16fa-425f-a804-3f5b7781f91b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:58.506023 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-349af027-16fa-425f-a804-3f5b7781f91b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:58.506699 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-349af027-16fa-425f-a804-3f5b7781f91b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:58.528458 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-349af027-16fa-425f-a804-3f5b7781f91b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Getting quotas for project f648ffbed31f4192b6f16124451b3559. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:48:58.533430 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-349af027-16fa-425f-a804-3f5b7781f91b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Getting quotas for user bf2c93aa211c4587a97533f4b4e50b11 and project f648ffbed31f4192b6f16124451b3559. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:48:58.545328 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-349af027-16fa-425f-a804-3f5b7781f91b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Going to run 1 instances... {{(pid=101272) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:48:58.547795 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-349af027-16fa-425f-a804-3f5b7781f91b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:48:58.597111 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-349af027-16fa-425f-a804-3f5b7781f91b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725415 Apr 08 02:48:58.602645 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 176/340] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:48:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:48:58.612191 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-7e042c30-70e1-48bc-a188-a2f4c163c2ad tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:58.612891 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-7e042c30-70e1-48bc-a188-a2f4c163c2ad tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:58.685008 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-7e042c30-70e1-48bc-a188-a2f4c163c2ad tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:58.693398 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-7e042c30-70e1-48bc-a188-a2f4c163c2ad tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1219 microversion: 2.1 time: 0.089090 Apr 08 02:48:58.694235 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 177/341] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:58 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:58.912023 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-84953950-c446-461b-a3c4-f4166e590f9a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:58.920408 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-84953950-c446-461b-a3c4-f4166e590f9a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1365 microversion: 2.1 time: 0.557272 Apr 08 02:48:58.921735 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 165/342] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:58 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1365 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:59.277666 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-063721bc-a6e9-4507-b800-3ccc12886acb tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:59.278269 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-063721bc-a6e9-4507-b800-3ccc12886acb tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:59.286440 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-063721bc-a6e9-4507-b800-3ccc12886acb tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:59.286885 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-063721bc-a6e9-4507-b800-3ccc12886acb tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:59.287644 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-063721bc-a6e9-4507-b800-3ccc12886acb tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:59.288111 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-063721bc-a6e9-4507-b800-3ccc12886acb tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:59.489164 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-063721bc-a6e9-4507-b800-3ccc12886acb tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:59.498017 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-063721bc-a6e9-4507-b800-3ccc12886acb tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:59.499512 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-063721bc-a6e9-4507-b800-3ccc12886acb tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:59.500790 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-063721bc-a6e9-4507-b800-3ccc12886acb tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1721 microversion: 2.20 time: 0.226773 Apr 08 02:48:59.501337 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 178/343] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:48:59 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:48:59.710404 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8c12d1d2-e338-4ac4-96eb-16141a9bf7e6 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:59.710986 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-8c12d1d2-e338-4ac4-96eb-16141a9bf7e6 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:59.722010 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8c12d1d2-e338-4ac4-96eb-16141a9bf7e6 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:59.722451 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8c12d1d2-e338-4ac4-96eb-16141a9bf7e6 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:59.723211 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8c12d1d2-e338-4ac4-96eb-16141a9bf7e6 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:59.723638 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8c12d1d2-e338-4ac4-96eb-16141a9bf7e6 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:59.839272 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-8c12d1d2-e338-4ac4-96eb-16141a9bf7e6 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:48:59.848896 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8c12d1d2-e338-4ac4-96eb-16141a9bf7e6 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1271 microversion: 2.1 time: 0.142171 Apr 08 02:48:59.849465 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 166/344] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:59 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1271 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:59.939021 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b2cd5705-bb13-4da6-9020-f7af4813dfa1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:59.939736 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b2cd5705-bb13-4da6-9020-f7af4813dfa1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:48:59.948068 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b2cd5705-bb13-4da6-9020-f7af4813dfa1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:59.948521 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b2cd5705-bb13-4da6-9020-f7af4813dfa1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:59.949470 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b2cd5705-bb13-4da6-9020-f7af4813dfa1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:59.950119 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b2cd5705-bb13-4da6-9020-f7af4813dfa1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:00.156568 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b2cd5705-bb13-4da6-9020-f7af4813dfa1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:00.165175 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b2cd5705-bb13-4da6-9020-f7af4813dfa1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1365 microversion: 2.1 time: 0.230826 Apr 08 02:49:00.165782 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 179/345] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:59 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:00.519356 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c5a4c1d1-8a60-457a-8932-d13fdb8660ed tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:00.519969 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c5a4c1d1-8a60-457a-8932-d13fdb8660ed tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:00.527190 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c5a4c1d1-8a60-457a-8932-d13fdb8660ed tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:00.527631 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c5a4c1d1-8a60-457a-8932-d13fdb8660ed tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:00.528422 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c5a4c1d1-8a60-457a-8932-d13fdb8660ed tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:00.528850 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c5a4c1d1-8a60-457a-8932-d13fdb8660ed tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:00.789144 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c5a4c1d1-8a60-457a-8932-d13fdb8660ed tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:00.798056 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c5a4c1d1-8a60-457a-8932-d13fdb8660ed tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:00.799548 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c5a4c1d1-8a60-457a-8932-d13fdb8660ed tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:00.800704 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c5a4c1d1-8a60-457a-8932-d13fdb8660ed tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1721 microversion: 2.20 time: 0.285984 Apr 08 02:49:00.801242 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 167/346] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:00 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1721 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:00.851851 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-201a334d-ca58-4908-8611-03846e1139ee req-8f74f87d-eabf-4e9b-865a-83d559d4ca24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7f7249-30e7-40a1-9854-881972b2ed1a", "name": "network-vif-plugged", "status": "completed", "tag": "666035a5-39af-4115-b103-73d896c88814"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:00.853409 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:49:00.853409 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:49:00.868337 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d420715e-31e9-4912-801a-916cbe20fa7e tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:00.868537 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-201a334d-ca58-4908-8611-03846e1139ee req-8f74f87d-eabf-4e9b-865a-83d559d4ca24 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:00.869164 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-201a334d-ca58-4908-8611-03846e1139ee req-8f74f87d-eabf-4e9b-865a-83d559d4ca24 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:00.869349 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-d420715e-31e9-4912-801a-916cbe20fa7e tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:00.878227 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d420715e-31e9-4912-801a-916cbe20fa7e tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:00.878805 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d420715e-31e9-4912-801a-916cbe20fa7e tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:00.879696 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d420715e-31e9-4912-801a-916cbe20fa7e tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:00.880304 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d420715e-31e9-4912-801a-916cbe20fa7e tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:00.891167 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-201a334d-ca58-4908-8611-03846e1139ee req-8f74f87d-eabf-4e9b-865a-83d559d4ca24 service nova] Creating event network-vif-plugged:666035a5-39af-4115-b103-73d896c88814 for instance df7f7249-30e7-40a1-9854-881972b2ed1a on hv-cinder-83705 Apr 08 02:49:00.902373 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-201a334d-ca58-4908-8611-03846e1139ee req-8f74f87d-eabf-4e9b-865a-83d559d4ca24 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056468 Apr 08 02:49:00.903181 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 180/347] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:49:01.169270 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-d420715e-31e9-4912-801a-916cbe20fa7e tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:01.181651 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-d420715e-31e9-4912-801a-916cbe20fa7e tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.317953 Apr 08 02:49:01.184749 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b414da26-7d0b-4181-ad09-a09b3f4d9289 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:01.192376 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 168/348] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:00 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:01.193205 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b414da26-7d0b-4181-ad09-a09b3f4d9289 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:01.207641 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b414da26-7d0b-4181-ad09-a09b3f4d9289 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:01.208127 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b414da26-7d0b-4181-ad09-a09b3f4d9289 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:01.208901 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b414da26-7d0b-4181-ad09-a09b3f4d9289 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:01.209330 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b414da26-7d0b-4181-ad09-a09b3f4d9289 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:01.460113 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b414da26-7d0b-4181-ad09-a09b3f4d9289 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:01.469317 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b414da26-7d0b-4181-ad09-a09b3f4d9289 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1365 microversion: 2.1 time: 0.290151 Apr 08 02:49:01.469887 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 181/349] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:01 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1365 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:49:01.818762 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-12a45e30-f4c2-4e69-92da-1d60949393c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:01.819314 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-12a45e30-f4c2-4e69-92da-1d60949393c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:01.826371 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-12a45e30-f4c2-4e69-92da-1d60949393c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:01.826809 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-12a45e30-f4c2-4e69-92da-1d60949393c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:01.828276 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-12a45e30-f4c2-4e69-92da-1d60949393c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:01.828711 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-12a45e30-f4c2-4e69-92da-1d60949393c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:02.039544 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-d58a8f39-a210-41eb-bed7-01b4f1efc4c2 req-f20fba44-d255-4752-b9bd-6907c01a3988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243402df-e2d8-46e4-9166-6762c267291f", "tag": "6f01f6ba-057e-4a68-b3cf-b0a236ca6707"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:02.041240 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:49:02.041240 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:49:02.049713 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-d58a8f39-a210-41eb-bed7-01b4f1efc4c2 req-f20fba44-d255-4752-b9bd-6907c01a3988 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:02.050161 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-d58a8f39-a210-41eb-bed7-01b4f1efc4c2 req-f20fba44-d255-4752-b9bd-6907c01a3988 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:02.072772 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-d58a8f39-a210-41eb-bed7-01b4f1efc4c2 req-f20fba44-d255-4752-b9bd-6907c01a3988 service nova] Creating event network-changed:6f01f6ba-057e-4a68-b3cf-b0a236ca6707 for instance 243402df-e2d8-46e4-9166-6762c267291f on hv-cinder-83705 Apr 08 02:49:02.077910 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-d58a8f39-a210-41eb-bed7-01b4f1efc4c2 req-f20fba44-d255-4752-b9bd-6907c01a3988 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041447 Apr 08 02:49:02.078635 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 182/350] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:49:02.201422 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b73c54a0-932b-45e7-b6d2-7664fa471ac3 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:02.202037 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b73c54a0-932b-45e7-b6d2-7664fa471ac3 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:02.209709 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b73c54a0-932b-45e7-b6d2-7664fa471ac3 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:02.210189 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b73c54a0-932b-45e7-b6d2-7664fa471ac3 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:02.211022 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b73c54a0-932b-45e7-b6d2-7664fa471ac3 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:02.211505 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b73c54a0-932b-45e7-b6d2-7664fa471ac3 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:02.244188 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-12a45e30-f4c2-4e69-92da-1d60949393c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:02.253017 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-12a45e30-f4c2-4e69-92da-1d60949393c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:02.254623 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-12a45e30-f4c2-4e69-92da-1d60949393c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:02.255806 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-12a45e30-f4c2-4e69-92da-1d60949393c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1724 microversion: 2.20 time: 0.440821 Apr 08 02:49:02.256642 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 169/351] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:01 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1724 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:02.276847 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-15811ee0-6e0d-49df-ba3a-fa41a8847910 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66339d64-fafc-4988-a496-b11d9878b1a4"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:02.277995 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-15811ee0-6e0d-49df-ba3a-fa41a8847910 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:02.290146 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-15811ee0-6e0d-49df-ba3a-fa41a8847910 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:02.291203 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-15811ee0-6e0d-49df-ba3a-fa41a8847910 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:02.292731 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-15811ee0-6e0d-49df-ba3a-fa41a8847910 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:02.293603 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-15811ee0-6e0d-49df-ba3a-fa41a8847910 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:02.415157 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b73c54a0-932b-45e7-b6d2-7664fa471ac3 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:02.423594 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b73c54a0-932b-45e7-b6d2-7664fa471ac3 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.226461 Apr 08 02:49:02.424193 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 183/352] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:02 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:49:02.486809 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-929750f0-502c-49ff-930b-fb5cdcf406b5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:02.487423 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-929750f0-502c-49ff-930b-fb5cdcf406b5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:02.509432 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-929750f0-502c-49ff-930b-fb5cdcf406b5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:02.510120 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-929750f0-502c-49ff-930b-fb5cdcf406b5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:02.511200 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-929750f0-502c-49ff-930b-fb5cdcf406b5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:02.511639 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-929750f0-502c-49ff-930b-fb5cdcf406b5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:02.805429 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-15811ee0-6e0d-49df-ba3a-fa41a8847910 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "POST /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.532944 Apr 08 02:49:02.806031 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 170/353] 10.222.0.23 () {62 vars in 1363 bytes} [Fri Apr 8 02:49:02 2022] POST /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/os-volume_attachments => generated 188 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:49:02.817878 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-929750f0-502c-49ff-930b-fb5cdcf406b5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:02.826326 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-929750f0-502c-49ff-930b-fb5cdcf406b5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1365 microversion: 2.1 time: 0.344193 Apr 08 02:49:02.827105 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 184/354] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:02 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1365 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:49:02.945472 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-69e475f2-6045-4eab-bac4-408e8d12a684 req-ba612b41-f906-46b7-a918-d30168c570bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a1344c-2d91-4224-ab68-1898d4aa8b0f", "name": "network-vif-unplugged", "status": "completed", "tag": "19d6323f-cbfa-4743-8474-008e1a45beee"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:02.948409 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:49:02.948409 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:49:02.957149 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-69e475f2-6045-4eab-bac4-408e8d12a684 req-ba612b41-f906-46b7-a918-d30168c570bb service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:02.957587 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-69e475f2-6045-4eab-bac4-408e8d12a684 req-ba612b41-f906-46b7-a918-d30168c570bb service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:02.974459 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.compute.server_external_events [req-69e475f2-6045-4eab-bac4-408e8d12a684 req-ba612b41-f906-46b7-a918-d30168c570bb service nova] Unable to find a host for instance 89a1344c-2d91-4224-ab68-1898d4aa8b0f. Dropping event network-vif-unplugged {{(pid=101271) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Apr 08 02:49:02.975325 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-69e475f2-6045-4eab-bac4-408e8d12a684 req-ba612b41-f906-46b7-a918-d30168c570bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034432 Apr 08 02:49:02.975894 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 171/355] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 08 02:49:02.986224 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-194fbcd6-e896-42a0-84a2-dfa1a368b48f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:02.986788 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-194fbcd6-e896-42a0-84a2-dfa1a368b48f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:02.994092 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-194fbcd6-e896-42a0-84a2-dfa1a368b48f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:02.994532 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-194fbcd6-e896-42a0-84a2-dfa1a368b48f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:02.995292 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-194fbcd6-e896-42a0-84a2-dfa1a368b48f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:02.995721 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-194fbcd6-e896-42a0-84a2-dfa1a368b48f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:03.141923 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-194fbcd6-e896-42a0-84a2-dfa1a368b48f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "POST /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/action" status: 202 len: 0 microversion: 2.20 time: 0.159811 Apr 08 02:49:03.145762 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 185/356] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Apr 8 02:49:02 2022] POST /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:49:03.151424 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b4313eab-e0c4-4731-b330-78dd3ee78b81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:03.152415 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b4313eab-e0c4-4731-b330-78dd3ee78b81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:03.167244 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b4313eab-e0c4-4731-b330-78dd3ee78b81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:03.168305 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b4313eab-e0c4-4731-b330-78dd3ee78b81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:03.169366 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b4313eab-e0c4-4731-b330-78dd3ee78b81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:03.169991 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b4313eab-e0c4-4731-b330-78dd3ee78b81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:03.441599 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0c013fc6-4291-4593-8d6c-c9d14208fce1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:03.442407 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0c013fc6-4291-4593-8d6c-c9d14208fce1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:03.451584 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0c013fc6-4291-4593-8d6c-c9d14208fce1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:03.452606 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0c013fc6-4291-4593-8d6c-c9d14208fce1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:03.453882 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0c013fc6-4291-4593-8d6c-c9d14208fce1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:03.454563 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0c013fc6-4291-4593-8d6c-c9d14208fce1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:03.464833 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b4313eab-e0c4-4731-b330-78dd3ee78b81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:03.478951 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b4313eab-e0c4-4731-b330-78dd3ee78b81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:03.483020 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b4313eab-e0c4-4731-b330-78dd3ee78b81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:03.487880 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b4313eab-e0c4-4731-b330-78dd3ee78b81 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1750 microversion: 2.20 time: 0.340352 Apr 08 02:49:03.498840 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 172/357] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:03 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1750 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:03.722855 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0c013fc6-4291-4593-8d6c-c9d14208fce1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:03.730996 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0c013fc6-4291-4593-8d6c-c9d14208fce1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.294441 Apr 08 02:49:03.731680 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 186/358] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:03 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:03.844518 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-af48e82b-9ef6-4e4d-b1ad-5f3fe34ada0e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:03.845479 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-af48e82b-9ef6-4e4d-b1ad-5f3fe34ada0e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:03.854368 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-af48e82b-9ef6-4e4d-b1ad-5f3fe34ada0e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:03.854824 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-af48e82b-9ef6-4e4d-b1ad-5f3fe34ada0e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:03.855607 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-af48e82b-9ef6-4e4d-b1ad-5f3fe34ada0e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:03.856405 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-af48e82b-9ef6-4e4d-b1ad-5f3fe34ada0e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:04.058699 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-af48e82b-9ef6-4e4d-b1ad-5f3fe34ada0e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:04.066787 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-af48e82b-9ef6-4e4d-b1ad-5f3fe34ada0e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1555 microversion: 2.1 time: 0.227155 Apr 08 02:49:04.067343 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 173/359] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:03 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:04.083374 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9b853c31-c03c-4905-be18-c0942d44bdfc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:04.083873 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9b853c31-c03c-4905-be18-c0942d44bdfc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:04.091113 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9b853c31-c03c-4905-be18-c0942d44bdfc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:04.091569 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9b853c31-c03c-4905-be18-c0942d44bdfc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:04.092385 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9b853c31-c03c-4905-be18-c0942d44bdfc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:04.092865 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9b853c31-c03c-4905-be18-c0942d44bdfc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:04.246435 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9b853c31-c03c-4905-be18-c0942d44bdfc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166844 Apr 08 02:49:04.247020 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 187/360] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Apr 8 02:49:04 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a/os-interface => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:49:04.506616 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d2f64960-f515-4e45-abed-248132ba49a4 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:04.507825 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-d2f64960-f515-4e45-abed-248132ba49a4 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:04.514607 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d2f64960-f515-4e45-abed-248132ba49a4 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:04.515286 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d2f64960-f515-4e45-abed-248132ba49a4 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:04.516096 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d2f64960-f515-4e45-abed-248132ba49a4 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:04.516699 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d2f64960-f515-4e45-abed-248132ba49a4 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:04.714713 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-d2f64960-f515-4e45-abed-248132ba49a4 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:04.725222 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-d2f64960-f515-4e45-abed-248132ba49a4 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:04.726868 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-d2f64960-f515-4e45-abed-248132ba49a4 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:04.728149 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-d2f64960-f515-4e45-abed-248132ba49a4 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1752 microversion: 2.20 time: 0.225386 Apr 08 02:49:04.729693 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 174/361] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:04 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1752 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:04.748403 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-23277959-a0ca-4406-ad8e-6da49e95e0fb tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:04.749176 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-23277959-a0ca-4406-ad8e-6da49e95e0fb tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:04.756805 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-23277959-a0ca-4406-ad8e-6da49e95e0fb tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:04.757301 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-23277959-a0ca-4406-ad8e-6da49e95e0fb tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:04.758475 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-23277959-a0ca-4406-ad8e-6da49e95e0fb tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:04.759010 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-23277959-a0ca-4406-ad8e-6da49e95e0fb tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:05.201162 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-23277959-a0ca-4406-ad8e-6da49e95e0fb tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:05.210366 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-23277959-a0ca-4406-ad8e-6da49e95e0fb tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.466270 Apr 08 02:49:05.210929 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 188/362] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:04 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:05.747604 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-116a6302-2506-4311-8860-77aaccb5f849 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:05.748216 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-116a6302-2506-4311-8860-77aaccb5f849 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:05.755957 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-116a6302-2506-4311-8860-77aaccb5f849 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:05.756423 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-116a6302-2506-4311-8860-77aaccb5f849 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:05.757198 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-116a6302-2506-4311-8860-77aaccb5f849 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:05.757630 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-116a6302-2506-4311-8860-77aaccb5f849 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:05.919230 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-b883fe9f-129b-4639-b66e-7a1ec4452ae1 req-8ea334bd-8c07-442f-87c5-678d894818e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df7f7249-30e7-40a1-9854-881972b2ed1a", "tag": "666035a5-39af-4115-b103-73d896c88814"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:05.919230 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:49:05.919230 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:49:05.928423 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-b883fe9f-129b-4639-b66e-7a1ec4452ae1 req-8ea334bd-8c07-442f-87c5-678d894818e4 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:05.928866 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-b883fe9f-129b-4639-b66e-7a1ec4452ae1 req-8ea334bd-8c07-442f-87c5-678d894818e4 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:05.945667 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-b883fe9f-129b-4639-b66e-7a1ec4452ae1 req-8ea334bd-8c07-442f-87c5-678d894818e4 service nova] Creating event network-changed:666035a5-39af-4115-b103-73d896c88814 for instance df7f7249-30e7-40a1-9854-881972b2ed1a on hv-cinder-83705 Apr 08 02:49:05.950418 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-b883fe9f-129b-4639-b66e-7a1ec4452ae1 req-8ea334bd-8c07-442f-87c5-678d894818e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036937 Apr 08 02:49:05.951335 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 189/363] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:49:06.111458 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-116a6302-2506-4311-8860-77aaccb5f849 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:06.120915 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-116a6302-2506-4311-8860-77aaccb5f849 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:06.122662 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-116a6302-2506-4311-8860-77aaccb5f849 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:06.124075 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-116a6302-2506-4311-8860-77aaccb5f849 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.380225 Apr 08 02:49:06.125090 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 175/364] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:05 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:06.227276 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ce94674d-a8de-4eb9-93f6-62b498e08277 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:06.227989 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ce94674d-a8de-4eb9-93f6-62b498e08277 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:06.236350 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce94674d-a8de-4eb9-93f6-62b498e08277 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:06.237182 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce94674d-a8de-4eb9-93f6-62b498e08277 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:06.238115 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce94674d-a8de-4eb9-93f6-62b498e08277 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:06.238706 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce94674d-a8de-4eb9-93f6-62b498e08277 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:06.607672 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ce94674d-a8de-4eb9-93f6-62b498e08277 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:06.617720 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ce94674d-a8de-4eb9-93f6-62b498e08277 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.394682 Apr 08 02:49:06.629327 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 190/365] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:06 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:07.142561 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-cce61d2c-b9eb-45f5-9724-05f2d3ba6575 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:07.143161 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-cce61d2c-b9eb-45f5-9724-05f2d3ba6575 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:07.150461 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cce61d2c-b9eb-45f5-9724-05f2d3ba6575 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:07.150906 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cce61d2c-b9eb-45f5-9724-05f2d3ba6575 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:07.151661 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cce61d2c-b9eb-45f5-9724-05f2d3ba6575 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:07.152139 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cce61d2c-b9eb-45f5-9724-05f2d3ba6575 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:07.356743 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-cce61d2c-b9eb-45f5-9724-05f2d3ba6575 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:07.366747 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-cce61d2c-b9eb-45f5-9724-05f2d3ba6575 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:07.368404 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-cce61d2c-b9eb-45f5-9724-05f2d3ba6575 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:07.369754 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-cce61d2c-b9eb-45f5-9724-05f2d3ba6575 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.231221 Apr 08 02:49:07.370593 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 176/366] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:07 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:07.634571 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d7a929e7-2cf7-4f11-9f58-cd07c1758856 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:07.635276 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d7a929e7-2cf7-4f11-9f58-cd07c1758856 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:07.649923 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d7a929e7-2cf7-4f11-9f58-cd07c1758856 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:07.650363 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d7a929e7-2cf7-4f11-9f58-cd07c1758856 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:07.651304 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d7a929e7-2cf7-4f11-9f58-cd07c1758856 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:07.651895 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d7a929e7-2cf7-4f11-9f58-cd07c1758856 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:07.884594 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d7a929e7-2cf7-4f11-9f58-cd07c1758856 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:07.894586 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d7a929e7-2cf7-4f11-9f58-cd07c1758856 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.263545 Apr 08 02:49:07.895165 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 191/367] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:07 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:08.387802 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-224a7dcd-1a93-4880-8118-3f7a5da80552 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:08.394957 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-224a7dcd-1a93-4880-8118-3f7a5da80552 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:08.404579 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-224a7dcd-1a93-4880-8118-3f7a5da80552 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:08.405028 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-224a7dcd-1a93-4880-8118-3f7a5da80552 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:08.406414 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-224a7dcd-1a93-4880-8118-3f7a5da80552 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:08.406847 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-224a7dcd-1a93-4880-8118-3f7a5da80552 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:08.609770 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-224a7dcd-1a93-4880-8118-3f7a5da80552 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:08.618694 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-224a7dcd-1a93-4880-8118-3f7a5da80552 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:08.620237 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-224a7dcd-1a93-4880-8118-3f7a5da80552 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:08.621350 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-224a7dcd-1a93-4880-8118-3f7a5da80552 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.237293 Apr 08 02:49:08.621894 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 177/368] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:08 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:08.911439 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-44124169-da86-4460-a4cd-64667c8760bc tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:08.912080 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-44124169-da86-4460-a4cd-64667c8760bc tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:08.919747 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-44124169-da86-4460-a4cd-64667c8760bc tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:08.920225 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-44124169-da86-4460-a4cd-64667c8760bc tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:08.921215 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-44124169-da86-4460-a4cd-64667c8760bc tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:08.921650 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-44124169-da86-4460-a4cd-64667c8760bc tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:09.203260 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-44124169-da86-4460-a4cd-64667c8760bc tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:09.211578 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-44124169-da86-4460-a4cd-64667c8760bc tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.303938 Apr 08 02:49:09.220833 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 192/369] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:08 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:09.640385 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f2ad1b46-d03a-4c91-9514-d4bfe47fdfd1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:09.641101 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f2ad1b46-d03a-4c91-9514-d4bfe47fdfd1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:09.648277 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f2ad1b46-d03a-4c91-9514-d4bfe47fdfd1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:09.648725 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f2ad1b46-d03a-4c91-9514-d4bfe47fdfd1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:09.649482 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f2ad1b46-d03a-4c91-9514-d4bfe47fdfd1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:09.649917 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f2ad1b46-d03a-4c91-9514-d4bfe47fdfd1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:09.853558 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f2ad1b46-d03a-4c91-9514-d4bfe47fdfd1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:09.865153 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f2ad1b46-d03a-4c91-9514-d4bfe47fdfd1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:09.866664 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f2ad1b46-d03a-4c91-9514-d4bfe47fdfd1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:09.867841 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f2ad1b46-d03a-4c91-9514-d4bfe47fdfd1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.231958 Apr 08 02:49:09.868703 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 178/370] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:09 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:10.228148 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2267796a-8e1d-473f-84e2-821ea3b5c821 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:10.228762 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2267796a-8e1d-473f-84e2-821ea3b5c821 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:10.236772 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2267796a-8e1d-473f-84e2-821ea3b5c821 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:10.237218 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2267796a-8e1d-473f-84e2-821ea3b5c821 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:10.237975 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2267796a-8e1d-473f-84e2-821ea3b5c821 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:10.238407 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2267796a-8e1d-473f-84e2-821ea3b5c821 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:10.441227 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2267796a-8e1d-473f-84e2-821ea3b5c821 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:10.449304 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2267796a-8e1d-473f-84e2-821ea3b5c821 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.224864 Apr 08 02:49:10.449860 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 193/371] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:10 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:10.886684 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-da7f020e-b75d-4ec5-b252-2200516df90a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:10.887301 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-da7f020e-b75d-4ec5-b252-2200516df90a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:10.895015 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-da7f020e-b75d-4ec5-b252-2200516df90a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:10.895463 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-da7f020e-b75d-4ec5-b252-2200516df90a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:10.896268 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-da7f020e-b75d-4ec5-b252-2200516df90a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:10.900730 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-da7f020e-b75d-4ec5-b252-2200516df90a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:10.910542 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-2264a64c-6e29-4d82-be98-b0d461546721 req-1cae73f2-e7b3-4da4-8632-5148411de75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243402df-e2d8-46e4-9166-6762c267291f", "name": "network-vif-plugged", "status": "completed", "tag": "6f01f6ba-057e-4a68-b3cf-b0a236ca6707"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:10.922532 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:49:10.922532 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:49:10.936080 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-2264a64c-6e29-4d82-be98-b0d461546721 req-1cae73f2-e7b3-4da4-8632-5148411de75e service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:10.940136 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-2264a64c-6e29-4d82-be98-b0d461546721 req-1cae73f2-e7b3-4da4-8632-5148411de75e service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:10.961653 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-2264a64c-6e29-4d82-be98-b0d461546721 req-1cae73f2-e7b3-4da4-8632-5148411de75e service nova] Creating event network-vif-plugged:6f01f6ba-057e-4a68-b3cf-b0a236ca6707 for instance 243402df-e2d8-46e4-9166-6762c267291f on hv-cinder-83705 Apr 08 02:49:10.966363 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-2264a64c-6e29-4d82-be98-b0d461546721 req-1cae73f2-e7b3-4da4-8632-5148411de75e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059767 Apr 08 02:49:10.966963 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 194/372] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:49:11.101705 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-da7f020e-b75d-4ec5-b252-2200516df90a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:11.111029 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-da7f020e-b75d-4ec5-b252-2200516df90a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:11.112548 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-da7f020e-b75d-4ec5-b252-2200516df90a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:11.113666 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-da7f020e-b75d-4ec5-b252-2200516df90a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.230768 Apr 08 02:49:11.114512 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 179/373] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:10 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:11.467089 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-bcd09af1-e95a-4c0e-ba75-4e6b99b98dd4 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:11.468474 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-bcd09af1-e95a-4c0e-ba75-4e6b99b98dd4 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:11.476377 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bcd09af1-e95a-4c0e-ba75-4e6b99b98dd4 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:11.476821 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bcd09af1-e95a-4c0e-ba75-4e6b99b98dd4 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:11.477583 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bcd09af1-e95a-4c0e-ba75-4e6b99b98dd4 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:11.478045 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bcd09af1-e95a-4c0e-ba75-4e6b99b98dd4 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:11.721850 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-bcd09af1-e95a-4c0e-ba75-4e6b99b98dd4 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:11.730195 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-bcd09af1-e95a-4c0e-ba75-4e6b99b98dd4 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.267175 Apr 08 02:49:11.730758 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 195/374] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:11 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:12.132994 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-51d924cd-be21-4e0d-8351-43f50aede79b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:12.133586 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-51d924cd-be21-4e0d-8351-43f50aede79b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:12.141432 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-51d924cd-be21-4e0d-8351-43f50aede79b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:12.141877 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-51d924cd-be21-4e0d-8351-43f50aede79b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:12.142627 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-51d924cd-be21-4e0d-8351-43f50aede79b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:12.143056 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-51d924cd-be21-4e0d-8351-43f50aede79b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:12.343706 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-51d924cd-be21-4e0d-8351-43f50aede79b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:12.353756 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-51d924cd-be21-4e0d-8351-43f50aede79b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:12.355193 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-51d924cd-be21-4e0d-8351-43f50aede79b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:12.356429 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-51d924cd-be21-4e0d-8351-43f50aede79b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.227212 Apr 08 02:49:12.356977 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 180/375] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:12 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:49:12.749366 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-18ff1298-5a8e-4eb3-831e-89219e5b1df0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:12.750123 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-18ff1298-5a8e-4eb3-831e-89219e5b1df0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:12.757536 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-18ff1298-5a8e-4eb3-831e-89219e5b1df0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:12.757982 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-18ff1298-5a8e-4eb3-831e-89219e5b1df0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:12.758743 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-18ff1298-5a8e-4eb3-831e-89219e5b1df0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:12.759175 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-18ff1298-5a8e-4eb3-831e-89219e5b1df0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:12.960539 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-18ff1298-5a8e-4eb3-831e-89219e5b1df0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:12.977161 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-18ff1298-5a8e-4eb3-831e-89219e5b1df0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.233052 Apr 08 02:49:12.977762 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 196/376] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:12 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:13.374518 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-09816a7b-fd98-41a1-b509-008624653a1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:13.376045 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-09816a7b-fd98-41a1-b509-008624653a1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:13.383036 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-09816a7b-fd98-41a1-b509-008624653a1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:13.383589 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-09816a7b-fd98-41a1-b509-008624653a1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:13.384277 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-09816a7b-fd98-41a1-b509-008624653a1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:13.384719 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-09816a7b-fd98-41a1-b509-008624653a1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:13.586401 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-09816a7b-fd98-41a1-b509-008624653a1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:13.596309 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-09816a7b-fd98-41a1-b509-008624653a1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:13.597879 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-09816a7b-fd98-41a1-b509-008624653a1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:13.599030 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-09816a7b-fd98-41a1-b509-008624653a1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.228285 Apr 08 02:49:13.599778 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 181/377] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:13 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:13.994352 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-47a71b67-3083-435c-8051-3ed6b3470088 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:13.994959 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-47a71b67-3083-435c-8051-3ed6b3470088 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:14.002761 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-47a71b67-3083-435c-8051-3ed6b3470088 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:14.003217 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-47a71b67-3083-435c-8051-3ed6b3470088 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:14.004016 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-47a71b67-3083-435c-8051-3ed6b3470088 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:14.004451 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-47a71b67-3083-435c-8051-3ed6b3470088 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:14.200964 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-47a71b67-3083-435c-8051-3ed6b3470088 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:14.210054 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-47a71b67-3083-435c-8051-3ed6b3470088 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.219182 Apr 08 02:49:14.212694 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 197/378] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:13 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:14.618106 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1f95b559-f70b-42d2-aaa5-da149a6e1591 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:14.619446 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1f95b559-f70b-42d2-aaa5-da149a6e1591 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:14.628261 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1f95b559-f70b-42d2-aaa5-da149a6e1591 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:14.628702 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1f95b559-f70b-42d2-aaa5-da149a6e1591 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:14.629481 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1f95b559-f70b-42d2-aaa5-da149a6e1591 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:14.629912 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1f95b559-f70b-42d2-aaa5-da149a6e1591 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:14.828747 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1f95b559-f70b-42d2-aaa5-da149a6e1591 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:14.837742 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1f95b559-f70b-42d2-aaa5-da149a6e1591 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:14.839246 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1f95b559-f70b-42d2-aaa5-da149a6e1591 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:14.840414 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1f95b559-f70b-42d2-aaa5-da149a6e1591 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.226058 Apr 08 02:49:14.840959 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 182/379] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:14 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:15.228695 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3777576a-56f1-4030-8cd4-dfcfe9de23d1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:15.229425 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-3777576a-56f1-4030-8cd4-dfcfe9de23d1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:15.237076 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3777576a-56f1-4030-8cd4-dfcfe9de23d1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:15.237771 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3777576a-56f1-4030-8cd4-dfcfe9de23d1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:15.238773 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3777576a-56f1-4030-8cd4-dfcfe9de23d1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:15.239401 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3777576a-56f1-4030-8cd4-dfcfe9de23d1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:15.446207 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-3777576a-56f1-4030-8cd4-dfcfe9de23d1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:15.454866 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3777576a-56f1-4030-8cd4-dfcfe9de23d1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.229865 Apr 08 02:49:15.455433 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 198/380] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:15 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:15.859093 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-228be3a5-1335-4d3b-a019-54b11b042d96 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:15.860250 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-228be3a5-1335-4d3b-a019-54b11b042d96 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:15.867558 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-228be3a5-1335-4d3b-a019-54b11b042d96 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:15.868041 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-228be3a5-1335-4d3b-a019-54b11b042d96 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:15.868806 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-228be3a5-1335-4d3b-a019-54b11b042d96 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:15.869239 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-228be3a5-1335-4d3b-a019-54b11b042d96 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:16.079170 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-228be3a5-1335-4d3b-a019-54b11b042d96 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:16.089197 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-228be3a5-1335-4d3b-a019-54b11b042d96 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:16.090696 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-228be3a5-1335-4d3b-a019-54b11b042d96 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:16.091838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-228be3a5-1335-4d3b-a019-54b11b042d96 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.236480 Apr 08 02:49:16.092709 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 183/381] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:15 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:16.475107 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-03409546-5f5a-4518-9d88-0b75cad5d749 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:16.475832 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-03409546-5f5a-4518-9d88-0b75cad5d749 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:16.484028 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-03409546-5f5a-4518-9d88-0b75cad5d749 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:16.485846 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-03409546-5f5a-4518-9d88-0b75cad5d749 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:16.486712 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-03409546-5f5a-4518-9d88-0b75cad5d749 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:16.487162 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-03409546-5f5a-4518-9d88-0b75cad5d749 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:16.690884 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-03409546-5f5a-4518-9d88-0b75cad5d749 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:16.698856 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-03409546-5f5a-4518-9d88-0b75cad5d749 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.227755 Apr 08 02:49:16.699406 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 199/382] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:16 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:16.754926 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 02:49:16.755182 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: Fri Apr 8 02:49:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 02:49:17.110589 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-230334ac-3293-4298-8578-7e41d569350a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:17.111340 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-230334ac-3293-4298-8578-7e41d569350a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:17.118396 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-230334ac-3293-4298-8578-7e41d569350a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:17.118835 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-230334ac-3293-4298-8578-7e41d569350a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:17.119585 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-230334ac-3293-4298-8578-7e41d569350a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:17.120047 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-230334ac-3293-4298-8578-7e41d569350a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:17.396838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-230334ac-3293-4298-8578-7e41d569350a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:17.406727 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-230334ac-3293-4298-8578-7e41d569350a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:17.409349 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-230334ac-3293-4298-8578-7e41d569350a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:17.410571 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-230334ac-3293-4298-8578-7e41d569350a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.304090 Apr 08 02:49:17.411256 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 184/383] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:17 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:17.716088 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-be242ed2-c87d-4888-b89c-6995905a02b2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:17.716762 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-be242ed2-c87d-4888-b89c-6995905a02b2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:17.724615 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-be242ed2-c87d-4888-b89c-6995905a02b2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:17.725064 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-be242ed2-c87d-4888-b89c-6995905a02b2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:17.725830 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-be242ed2-c87d-4888-b89c-6995905a02b2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:17.726265 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-be242ed2-c87d-4888-b89c-6995905a02b2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:17.925043 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-be242ed2-c87d-4888-b89c-6995905a02b2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:17.933646 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-be242ed2-c87d-4888-b89c-6995905a02b2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.221397 Apr 08 02:49:17.934217 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 200/384] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:17 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:18.429477 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-12ac39ff-96c3-4f84-b2d3-0ac19f8af954 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:18.430112 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-12ac39ff-96c3-4f84-b2d3-0ac19f8af954 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:18.437554 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-12ac39ff-96c3-4f84-b2d3-0ac19f8af954 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:18.438119 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-12ac39ff-96c3-4f84-b2d3-0ac19f8af954 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:18.438888 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-12ac39ff-96c3-4f84-b2d3-0ac19f8af954 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:18.439328 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-12ac39ff-96c3-4f84-b2d3-0ac19f8af954 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:18.640176 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-12ac39ff-96c3-4f84-b2d3-0ac19f8af954 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:18.650480 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-12ac39ff-96c3-4f84-b2d3-0ac19f8af954 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:18.651997 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-12ac39ff-96c3-4f84-b2d3-0ac19f8af954 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:18.653137 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-12ac39ff-96c3-4f84-b2d3-0ac19f8af954 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.227662 Apr 08 02:49:18.653677 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 185/385] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:18 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:18.950362 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-53ba4570-c328-4e7d-8347-14e17f7958aa tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:18.951078 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-53ba4570-c328-4e7d-8347-14e17f7958aa tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:18.959483 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-53ba4570-c328-4e7d-8347-14e17f7958aa tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:18.959948 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-53ba4570-c328-4e7d-8347-14e17f7958aa tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:18.960726 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-53ba4570-c328-4e7d-8347-14e17f7958aa tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:18.961159 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-53ba4570-c328-4e7d-8347-14e17f7958aa tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:19.162671 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-53ba4570-c328-4e7d-8347-14e17f7958aa tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:19.170834 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-53ba4570-c328-4e7d-8347-14e17f7958aa tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.224376 Apr 08 02:49:19.171384 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 201/386] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:18 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:19.670773 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f545d29c-2cf5-41af-b48e-7ef32945c8a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:19.671365 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f545d29c-2cf5-41af-b48e-7ef32945c8a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:19.680142 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f545d29c-2cf5-41af-b48e-7ef32945c8a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:19.680577 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f545d29c-2cf5-41af-b48e-7ef32945c8a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:19.681664 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f545d29c-2cf5-41af-b48e-7ef32945c8a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:19.682476 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f545d29c-2cf5-41af-b48e-7ef32945c8a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:19.876833 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f545d29c-2cf5-41af-b48e-7ef32945c8a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:19.885750 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f545d29c-2cf5-41af-b48e-7ef32945c8a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:19.887263 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f545d29c-2cf5-41af-b48e-7ef32945c8a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:19.888431 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f545d29c-2cf5-41af-b48e-7ef32945c8a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.221513 Apr 08 02:49:19.888981 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 186/387] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:19 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:20.193839 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-934dfce2-acc1-44bd-8572-6314f8ba462f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:20.197838 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-934dfce2-acc1-44bd-8572-6314f8ba462f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:20.209955 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-934dfce2-acc1-44bd-8572-6314f8ba462f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:20.210400 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-934dfce2-acc1-44bd-8572-6314f8ba462f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:20.211173 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-934dfce2-acc1-44bd-8572-6314f8ba462f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:20.211602 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-934dfce2-acc1-44bd-8572-6314f8ba462f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:20.414477 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-934dfce2-acc1-44bd-8572-6314f8ba462f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:20.422752 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-934dfce2-acc1-44bd-8572-6314f8ba462f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.235169 Apr 08 02:49:20.423320 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 202/388] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:20 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:20.907230 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-9da4237e-dd22-450c-b3f4-bd0b3851c2ff tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:20.907986 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-9da4237e-dd22-450c-b3f4-bd0b3851c2ff tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:20.915905 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9da4237e-dd22-450c-b3f4-bd0b3851c2ff tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:20.916402 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9da4237e-dd22-450c-b3f4-bd0b3851c2ff tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:20.917171 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9da4237e-dd22-450c-b3f4-bd0b3851c2ff tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:20.917622 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9da4237e-dd22-450c-b3f4-bd0b3851c2ff tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:21.132073 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-9da4237e-dd22-450c-b3f4-bd0b3851c2ff tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:21.142826 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-9da4237e-dd22-450c-b3f4-bd0b3851c2ff tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:21.144487 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-9da4237e-dd22-450c-b3f4-bd0b3851c2ff tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:21.145628 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-9da4237e-dd22-450c-b3f4-bd0b3851c2ff tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.242126 Apr 08 02:49:21.146184 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 187/389] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:20 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:21.441372 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-42e53eff-8219-4063-9758-7282d6065c91 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:21.442116 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-42e53eff-8219-4063-9758-7282d6065c91 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:21.449407 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-42e53eff-8219-4063-9758-7282d6065c91 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:21.449849 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-42e53eff-8219-4063-9758-7282d6065c91 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:21.450612 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-42e53eff-8219-4063-9758-7282d6065c91 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:21.451037 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-42e53eff-8219-4063-9758-7282d6065c91 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:21.656841 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-42e53eff-8219-4063-9758-7282d6065c91 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:21.665677 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-42e53eff-8219-4063-9758-7282d6065c91 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.230472 Apr 08 02:49:21.666243 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 203/390] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:21 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:22.165210 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-93476555-4b39-4cfd-858a-a74cbf3250c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:22.165887 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-93476555-4b39-4cfd-858a-a74cbf3250c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:22.175167 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-93476555-4b39-4cfd-858a-a74cbf3250c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:22.175613 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-93476555-4b39-4cfd-858a-a74cbf3250c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:22.176425 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-93476555-4b39-4cfd-858a-a74cbf3250c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:22.177146 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-93476555-4b39-4cfd-858a-a74cbf3250c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:22.374642 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-93476555-4b39-4cfd-858a-a74cbf3250c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:22.384608 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-93476555-4b39-4cfd-858a-a74cbf3250c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:22.386117 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-93476555-4b39-4cfd-858a-a74cbf3250c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:22.387254 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-93476555-4b39-4cfd-858a-a74cbf3250c9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.225836 Apr 08 02:49:22.388162 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 188/391] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:22 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:22.683046 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f46f539f-c366-4680-8d2a-38132cdb3e6d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:22.683655 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f46f539f-c366-4680-8d2a-38132cdb3e6d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:22.692472 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f46f539f-c366-4680-8d2a-38132cdb3e6d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:22.692918 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f46f539f-c366-4680-8d2a-38132cdb3e6d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:22.693689 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f46f539f-c366-4680-8d2a-38132cdb3e6d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:22.694120 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f46f539f-c366-4680-8d2a-38132cdb3e6d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:22.895839 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f46f539f-c366-4680-8d2a-38132cdb3e6d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:22.903867 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f46f539f-c366-4680-8d2a-38132cdb3e6d tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.224504 Apr 08 02:49:22.904443 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 204/392] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:22 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:23.406420 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a009899f-ecdb-4505-8ae6-2667bd422dcf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:23.407280 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a009899f-ecdb-4505-8ae6-2667bd422dcf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:23.414949 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a009899f-ecdb-4505-8ae6-2667bd422dcf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:23.415390 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a009899f-ecdb-4505-8ae6-2667bd422dcf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:23.416203 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a009899f-ecdb-4505-8ae6-2667bd422dcf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:23.416633 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a009899f-ecdb-4505-8ae6-2667bd422dcf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:23.610202 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a009899f-ecdb-4505-8ae6-2667bd422dcf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:23.619747 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a009899f-ecdb-4505-8ae6-2667bd422dcf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:23.621284 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a009899f-ecdb-4505-8ae6-2667bd422dcf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:23.622410 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a009899f-ecdb-4505-8ae6-2667bd422dcf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.219735 Apr 08 02:49:23.622951 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 189/393] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:23 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:23.919263 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ddc8e33d-0cb9-4065-a0c7-68917d96070f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:23.919873 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ddc8e33d-0cb9-4065-a0c7-68917d96070f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:23.927937 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ddc8e33d-0cb9-4065-a0c7-68917d96070f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:23.928389 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ddc8e33d-0cb9-4065-a0c7-68917d96070f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:23.929143 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ddc8e33d-0cb9-4065-a0c7-68917d96070f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:23.929572 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ddc8e33d-0cb9-4065-a0c7-68917d96070f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:24.129948 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ddc8e33d-0cb9-4065-a0c7-68917d96070f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:24.137854 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ddc8e33d-0cb9-4065-a0c7-68917d96070f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.222089 Apr 08 02:49:24.138401 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 205/394] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:23 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:24.640205 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-50835c77-6eed-4069-ae87-550e4fd6c94a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:24.640812 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-50835c77-6eed-4069-ae87-550e4fd6c94a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:24.648124 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-50835c77-6eed-4069-ae87-550e4fd6c94a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:24.648571 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-50835c77-6eed-4069-ae87-550e4fd6c94a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:24.649327 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-50835c77-6eed-4069-ae87-550e4fd6c94a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:24.649761 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-50835c77-6eed-4069-ae87-550e4fd6c94a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:24.843145 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-50835c77-6eed-4069-ae87-550e4fd6c94a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:24.852839 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-50835c77-6eed-4069-ae87-550e4fd6c94a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:24.854441 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-50835c77-6eed-4069-ae87-550e4fd6c94a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:24.855576 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-50835c77-6eed-4069-ae87-550e4fd6c94a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.219146 Apr 08 02:49:24.856161 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 190/395] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:24 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:25.154837 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-6d8afc81-0350-41d8-a304-460bdef6fb4f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:25.155453 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-6d8afc81-0350-41d8-a304-460bdef6fb4f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:25.163382 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6d8afc81-0350-41d8-a304-460bdef6fb4f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:25.163830 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6d8afc81-0350-41d8-a304-460bdef6fb4f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:25.164628 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6d8afc81-0350-41d8-a304-460bdef6fb4f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:25.165062 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6d8afc81-0350-41d8-a304-460bdef6fb4f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:25.356151 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-6d8afc81-0350-41d8-a304-460bdef6fb4f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:25.364343 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-6d8afc81-0350-41d8-a304-460bdef6fb4f tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.213183 Apr 08 02:49:25.364909 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 206/396] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:25 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:25.874308 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-be7f0445-ef23-438c-b769-38cbcfc4753d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:25.875071 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-be7f0445-ef23-438c-b769-38cbcfc4753d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:25.883079 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-be7f0445-ef23-438c-b769-38cbcfc4753d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:25.883525 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-be7f0445-ef23-438c-b769-38cbcfc4753d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:25.884322 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-be7f0445-ef23-438c-b769-38cbcfc4753d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:25.884754 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-be7f0445-ef23-438c-b769-38cbcfc4753d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:26.085544 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-be7f0445-ef23-438c-b769-38cbcfc4753d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:26.096071 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-be7f0445-ef23-438c-b769-38cbcfc4753d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:26.097405 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-be7f0445-ef23-438c-b769-38cbcfc4753d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:26.098531 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-be7f0445-ef23-438c-b769-38cbcfc4753d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.228019 Apr 08 02:49:26.099090 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 191/397] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:25 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:26.386004 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e1454c53-3a3f-4256-abb2-a4c5c7c7437e tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:26.386618 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e1454c53-3a3f-4256-abb2-a4c5c7c7437e tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:26.393925 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e1454c53-3a3f-4256-abb2-a4c5c7c7437e tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:26.394373 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e1454c53-3a3f-4256-abb2-a4c5c7c7437e tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:26.395142 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e1454c53-3a3f-4256-abb2-a4c5c7c7437e tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:26.395579 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e1454c53-3a3f-4256-abb2-a4c5c7c7437e tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:26.590349 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e1454c53-3a3f-4256-abb2-a4c5c7c7437e tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:26.598422 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e1454c53-3a3f-4256-abb2-a4c5c7c7437e tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.216107 Apr 08 02:49:26.598980 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 207/398] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:26 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:27.116969 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8d4065b1-707e-4f83-9285-99cd44ee92e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:27.117602 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-8d4065b1-707e-4f83-9285-99cd44ee92e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:27.124851 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8d4065b1-707e-4f83-9285-99cd44ee92e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:27.125294 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8d4065b1-707e-4f83-9285-99cd44ee92e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:27.126055 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8d4065b1-707e-4f83-9285-99cd44ee92e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:27.126477 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8d4065b1-707e-4f83-9285-99cd44ee92e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:27.314817 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-8d4065b1-707e-4f83-9285-99cd44ee92e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:27.323793 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-8d4065b1-707e-4f83-9285-99cd44ee92e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:27.325310 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-8d4065b1-707e-4f83-9285-99cd44ee92e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:27.326425 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8d4065b1-707e-4f83-9285-99cd44ee92e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.213209 Apr 08 02:49:27.326976 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 192/399] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:27 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:27.614894 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-526e8227-a173-4e27-bc48-98b5ede57409 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:27.615535 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-526e8227-a173-4e27-bc48-98b5ede57409 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:27.622838 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-526e8227-a173-4e27-bc48-98b5ede57409 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:27.623288 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-526e8227-a173-4e27-bc48-98b5ede57409 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:27.624083 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-526e8227-a173-4e27-bc48-98b5ede57409 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:27.624519 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-526e8227-a173-4e27-bc48-98b5ede57409 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:27.816363 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-526e8227-a173-4e27-bc48-98b5ede57409 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:27.824313 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-526e8227-a173-4e27-bc48-98b5ede57409 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1319 microversion: 2.1 time: 0.213099 Apr 08 02:49:27.824875 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 208/400] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:27 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:28.344544 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2647caa5-be22-443c-a048-c073610f5193 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:28.346153 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2647caa5-be22-443c-a048-c073610f5193 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:28.353181 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2647caa5-be22-443c-a048-c073610f5193 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:28.353631 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2647caa5-be22-443c-a048-c073610f5193 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:28.354669 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2647caa5-be22-443c-a048-c073610f5193 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:28.354858 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2647caa5-be22-443c-a048-c073610f5193 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:28.566460 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2647caa5-be22-443c-a048-c073610f5193 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:28.576164 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2647caa5-be22-443c-a048-c073610f5193 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:28.577665 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2647caa5-be22-443c-a048-c073610f5193 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:28.578787 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2647caa5-be22-443c-a048-c073610f5193 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.238017 Apr 08 02:49:28.579884 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 193/401] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:28 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:28.841189 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-28cb5698-8b23-4304-9e74-743664370dd0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:28.841804 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-28cb5698-8b23-4304-9e74-743664370dd0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:28.849869 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-28cb5698-8b23-4304-9e74-743664370dd0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:28.850354 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-28cb5698-8b23-4304-9e74-743664370dd0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:28.851123 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-28cb5698-8b23-4304-9e74-743664370dd0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:28.851583 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-28cb5698-8b23-4304-9e74-743664370dd0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:29.041847 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-28cb5698-8b23-4304-9e74-743664370dd0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:29.050145 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-28cb5698-8b23-4304-9e74-743664370dd0 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1508 microversion: 2.1 time: 0.212648 Apr 08 02:49:29.050702 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 209/402] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:28 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:29.066931 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2321a1fc-8a75-479c-bb67-4625f9a16729 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e22fc030-ac36-467c-aab8-675214a16927", "device": "/dev/sdb"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:29.068605 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2321a1fc-8a75-479c-bb67-4625f9a16729 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:29.075719 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2321a1fc-8a75-479c-bb67-4625f9a16729 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:29.076195 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2321a1fc-8a75-479c-bb67-4625f9a16729 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:29.076960 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2321a1fc-8a75-479c-bb67-4625f9a16729 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:29.077390 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2321a1fc-8a75-479c-bb67-4625f9a16729 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:29.443715 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2321a1fc-8a75-479c-bb67-4625f9a16729 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "POST /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381147 Apr 08 02:49:29.444423 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 194/403] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Apr 8 02:49:29 2022] POST /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:49:29.598072 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c496fad0-bbe7-4114-9129-961676833eec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:29.598684 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c496fad0-bbe7-4114-9129-961676833eec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:29.606334 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c496fad0-bbe7-4114-9129-961676833eec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:29.606785 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c496fad0-bbe7-4114-9129-961676833eec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:29.607558 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c496fad0-bbe7-4114-9129-961676833eec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:29.608028 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c496fad0-bbe7-4114-9129-961676833eec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:29.868566 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c496fad0-bbe7-4114-9129-961676833eec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:29.877881 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c496fad0-bbe7-4114-9129-961676833eec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:29.879429 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c496fad0-bbe7-4114-9129-961676833eec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:29.880583 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c496fad0-bbe7-4114-9129-961676833eec tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.286376 Apr 08 02:49:29.881133 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 210/404] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:29 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:49:30.899359 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-13de953b-209a-4f76-b5b7-7469d5834391 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:30.900032 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-13de953b-209a-4f76-b5b7-7469d5834391 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:30.908972 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-13de953b-209a-4f76-b5b7-7469d5834391 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:30.909417 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-13de953b-209a-4f76-b5b7-7469d5834391 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:30.910173 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-13de953b-209a-4f76-b5b7-7469d5834391 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:30.910603 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-13de953b-209a-4f76-b5b7-7469d5834391 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:31.101333 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-13de953b-209a-4f76-b5b7-7469d5834391 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:31.110461 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-13de953b-209a-4f76-b5b7-7469d5834391 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:31.111984 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-13de953b-209a-4f76-b5b7-7469d5834391 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:31.113109 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-13de953b-209a-4f76-b5b7-7469d5834391 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.218076 Apr 08 02:49:31.113656 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 195/405] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:30 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:32.130893 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3dc32119-4248-46dc-958f-2036d4de363a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:32.131495 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-3dc32119-4248-46dc-958f-2036d4de363a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:32.138781 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3dc32119-4248-46dc-958f-2036d4de363a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:32.139226 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3dc32119-4248-46dc-958f-2036d4de363a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:32.140006 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3dc32119-4248-46dc-958f-2036d4de363a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:32.140438 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3dc32119-4248-46dc-958f-2036d4de363a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:32.332729 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-3dc32119-4248-46dc-958f-2036d4de363a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:32.341706 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-3dc32119-4248-46dc-958f-2036d4de363a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:32.343195 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-3dc32119-4248-46dc-958f-2036d4de363a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:32.344347 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3dc32119-4248-46dc-958f-2036d4de363a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.217309 Apr 08 02:49:32.345883 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 211/406] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:32 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:33.362978 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-28388eb1-0322-4217-bb07-241f3f83e062 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:33.363604 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-28388eb1-0322-4217-bb07-241f3f83e062 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:33.370988 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-28388eb1-0322-4217-bb07-241f3f83e062 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:33.371430 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-28388eb1-0322-4217-bb07-241f3f83e062 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:33.372205 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-28388eb1-0322-4217-bb07-241f3f83e062 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:33.372641 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-28388eb1-0322-4217-bb07-241f3f83e062 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:33.569406 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-28388eb1-0322-4217-bb07-241f3f83e062 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:33.579726 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-28388eb1-0322-4217-bb07-241f3f83e062 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:33.581755 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-28388eb1-0322-4217-bb07-241f3f83e062 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:33.582867 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-28388eb1-0322-4217-bb07-241f3f83e062 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.223925 Apr 08 02:49:33.583416 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 196/407] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:33 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:34.600962 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-88edb233-a60a-4257-b11e-2de3fe07a0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:34.601579 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-88edb233-a60a-4257-b11e-2de3fe07a0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:34.608825 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-88edb233-a60a-4257-b11e-2de3fe07a0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:34.609275 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-88edb233-a60a-4257-b11e-2de3fe07a0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:34.610046 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-88edb233-a60a-4257-b11e-2de3fe07a0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:34.611060 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-88edb233-a60a-4257-b11e-2de3fe07a0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:34.849369 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-88edb233-a60a-4257-b11e-2de3fe07a0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:34.859561 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-88edb233-a60a-4257-b11e-2de3fe07a0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:34.861669 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-88edb233-a60a-4257-b11e-2de3fe07a0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:34.862806 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-88edb233-a60a-4257-b11e-2de3fe07a0a9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.265596 Apr 08 02:49:34.863358 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 212/408] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:34 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:35.881585 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b0d449a8-9297-4c6d-b3e3-934a6a74fe17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:35.882194 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b0d449a8-9297-4c6d-b3e3-934a6a74fe17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:35.889396 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b0d449a8-9297-4c6d-b3e3-934a6a74fe17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:35.889785 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b0d449a8-9297-4c6d-b3e3-934a6a74fe17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:35.890549 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b0d449a8-9297-4c6d-b3e3-934a6a74fe17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:35.890982 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b0d449a8-9297-4c6d-b3e3-934a6a74fe17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:36.097444 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b0d449a8-9297-4c6d-b3e3-934a6a74fe17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:36.106960 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b0d449a8-9297-4c6d-b3e3-934a6a74fe17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:36.108476 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b0d449a8-9297-4c6d-b3e3-934a6a74fe17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:36.109595 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b0d449a8-9297-4c6d-b3e3-934a6a74fe17 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.231773 Apr 08 02:49:36.111018 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 197/409] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:35 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:49:37.129407 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-efc3f463-bd33-46c1-af00-94b92963c324 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:37.130013 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-efc3f463-bd33-46c1-af00-94b92963c324 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:37.137317 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-efc3f463-bd33-46c1-af00-94b92963c324 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:37.137760 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-efc3f463-bd33-46c1-af00-94b92963c324 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:37.138511 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-efc3f463-bd33-46c1-af00-94b92963c324 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:37.138939 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-efc3f463-bd33-46c1-af00-94b92963c324 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:37.337279 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-efc3f463-bd33-46c1-af00-94b92963c324 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:37.347003 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-efc3f463-bd33-46c1-af00-94b92963c324 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:37.348603 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-efc3f463-bd33-46c1-af00-94b92963c324 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:37.349741 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-efc3f463-bd33-46c1-af00-94b92963c324 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.224773 Apr 08 02:49:37.350298 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 213/410] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:37 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:38.369704 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-0da89100-bb75-4c54-8e68-16a3f7539dad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:38.370308 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-0da89100-bb75-4c54-8e68-16a3f7539dad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:38.377863 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0da89100-bb75-4c54-8e68-16a3f7539dad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:38.378315 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0da89100-bb75-4c54-8e68-16a3f7539dad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:38.379079 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0da89100-bb75-4c54-8e68-16a3f7539dad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:38.379513 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0da89100-bb75-4c54-8e68-16a3f7539dad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:38.576842 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0da89100-bb75-4c54-8e68-16a3f7539dad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:38.586430 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0da89100-bb75-4c54-8e68-16a3f7539dad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:38.587944 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0da89100-bb75-4c54-8e68-16a3f7539dad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:38.589084 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-0da89100-bb75-4c54-8e68-16a3f7539dad tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.223113 Apr 08 02:49:38.589652 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 198/411] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:38 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:39.607540 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c550e03d-ec22-48c8-a54d-bd8d4b27dfdf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:39.608424 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c550e03d-ec22-48c8-a54d-bd8d4b27dfdf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:39.616199 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c550e03d-ec22-48c8-a54d-bd8d4b27dfdf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:39.616641 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c550e03d-ec22-48c8-a54d-bd8d4b27dfdf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:39.617401 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c550e03d-ec22-48c8-a54d-bd8d4b27dfdf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:39.617831 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c550e03d-ec22-48c8-a54d-bd8d4b27dfdf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:39.809773 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c550e03d-ec22-48c8-a54d-bd8d4b27dfdf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:39.819325 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c550e03d-ec22-48c8-a54d-bd8d4b27dfdf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:39.820854 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c550e03d-ec22-48c8-a54d-bd8d4b27dfdf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:39.821981 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c550e03d-ec22-48c8-a54d-bd8d4b27dfdf tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.218760 Apr 08 02:49:39.822540 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 214/412] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:39 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:40.839702 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-0b23ed79-f206-43ca-86e9-727529e6a3a1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:40.840344 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-0b23ed79-f206-43ca-86e9-727529e6a3a1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:40.848240 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0b23ed79-f206-43ca-86e9-727529e6a3a1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:40.848691 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0b23ed79-f206-43ca-86e9-727529e6a3a1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:40.849457 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0b23ed79-f206-43ca-86e9-727529e6a3a1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:40.849898 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0b23ed79-f206-43ca-86e9-727529e6a3a1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:41.049748 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0b23ed79-f206-43ca-86e9-727529e6a3a1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:41.059025 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0b23ed79-f206-43ca-86e9-727529e6a3a1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:41.060748 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0b23ed79-f206-43ca-86e9-727529e6a3a1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:41.061871 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-0b23ed79-f206-43ca-86e9-727529e6a3a1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.225971 Apr 08 02:49:41.062414 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 199/413] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:40 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:42.081809 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-8efa7d07-7437-471d-b72c-1de76059d9b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:42.082420 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-8efa7d07-7437-471d-b72c-1de76059d9b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:42.089784 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8efa7d07-7437-471d-b72c-1de76059d9b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:42.090230 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8efa7d07-7437-471d-b72c-1de76059d9b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:42.090989 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8efa7d07-7437-471d-b72c-1de76059d9b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:42.091432 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8efa7d07-7437-471d-b72c-1de76059d9b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:42.284796 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-8efa7d07-7437-471d-b72c-1de76059d9b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:42.293774 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-8efa7d07-7437-471d-b72c-1de76059d9b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:42.295299 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-8efa7d07-7437-471d-b72c-1de76059d9b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:42.296452 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-8efa7d07-7437-471d-b72c-1de76059d9b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.219148 Apr 08 02:49:42.297177 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 215/414] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:42 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:43.314536 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-bbff1758-460e-4472-80ca-fac70efb1941 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:43.315152 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-bbff1758-460e-4472-80ca-fac70efb1941 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:43.322384 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-bbff1758-460e-4472-80ca-fac70efb1941 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:43.322833 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-bbff1758-460e-4472-80ca-fac70efb1941 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:43.323594 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-bbff1758-460e-4472-80ca-fac70efb1941 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:43.324056 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-bbff1758-460e-4472-80ca-fac70efb1941 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:43.531413 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-bbff1758-460e-4472-80ca-fac70efb1941 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:43.541439 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-bbff1758-460e-4472-80ca-fac70efb1941 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:43.543289 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-bbff1758-460e-4472-80ca-fac70efb1941 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:43.545062 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-bbff1758-460e-4472-80ca-fac70efb1941 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.234215 Apr 08 02:49:43.545623 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 200/415] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:43 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:44.562794 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3bdafb5b-3976-4427-9677-957920439d2b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:44.563422 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-3bdafb5b-3976-4427-9677-957920439d2b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:44.570920 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3bdafb5b-3976-4427-9677-957920439d2b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:44.571371 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3bdafb5b-3976-4427-9677-957920439d2b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:44.572176 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3bdafb5b-3976-4427-9677-957920439d2b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:44.572611 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3bdafb5b-3976-4427-9677-957920439d2b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:44.765694 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-3bdafb5b-3976-4427-9677-957920439d2b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:44.775417 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-3bdafb5b-3976-4427-9677-957920439d2b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:44.776959 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-3bdafb5b-3976-4427-9677-957920439d2b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:44.778080 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3bdafb5b-3976-4427-9677-957920439d2b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.218997 Apr 08 02:49:44.778628 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 216/416] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:44 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:45.796326 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b4ea124f-a937-472c-91a4-8d35b0963a80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:45.796867 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b4ea124f-a937-472c-91a4-8d35b0963a80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:45.805146 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b4ea124f-a937-472c-91a4-8d35b0963a80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:45.805592 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b4ea124f-a937-472c-91a4-8d35b0963a80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:45.806354 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b4ea124f-a937-472c-91a4-8d35b0963a80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:45.806789 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b4ea124f-a937-472c-91a4-8d35b0963a80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:46.000377 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b4ea124f-a937-472c-91a4-8d35b0963a80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:46.014261 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b4ea124f-a937-472c-91a4-8d35b0963a80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:46.015761 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b4ea124f-a937-472c-91a4-8d35b0963a80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:46.018038 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b4ea124f-a937-472c-91a4-8d35b0963a80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.225545 Apr 08 02:49:46.018610 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 201/417] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:45 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:47.036500 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-269a49a9-6209-454b-8ef8-bdb00817de82 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:47.037105 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-269a49a9-6209-454b-8ef8-bdb00817de82 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:47.044464 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-269a49a9-6209-454b-8ef8-bdb00817de82 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:47.044919 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-269a49a9-6209-454b-8ef8-bdb00817de82 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:47.045687 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-269a49a9-6209-454b-8ef8-bdb00817de82 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:47.046121 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-269a49a9-6209-454b-8ef8-bdb00817de82 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:47.257593 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-269a49a9-6209-454b-8ef8-bdb00817de82 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:47.269753 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-79dc7ff1-5421-41fa-9de6-0c11a4fdd30a req-e0de809f-fef0-403d-a139-edf760b07d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a1344c-2d91-4224-ab68-1898d4aa8b0f", "name": "network-vif-plugged", "status": "completed", "tag": "19d6323f-cbfa-4743-8474-008e1a45beee"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:47.271329 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:49:47.271329 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:49:47.279440 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-269a49a9-6209-454b-8ef8-bdb00817de82 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:47.280050 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-79dc7ff1-5421-41fa-9de6-0c11a4fdd30a req-e0de809f-fef0-403d-a139-edf760b07d70 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:47.280606 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-79dc7ff1-5421-41fa-9de6-0c11a4fdd30a req-e0de809f-fef0-403d-a139-edf760b07d70 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:47.280988 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-269a49a9-6209-454b-8ef8-bdb00817de82 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:47.282163 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-269a49a9-6209-454b-8ef8-bdb00817de82 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.249537 Apr 08 02:49:47.292820 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 217/418] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:47 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:47.298283 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-79dc7ff1-5421-41fa-9de6-0c11a4fdd30a req-e0de809f-fef0-403d-a139-edf760b07d70 service nova] Creating event network-vif-plugged:19d6323f-cbfa-4743-8474-008e1a45beee for instance 89a1344c-2d91-4224-ab68-1898d4aa8b0f on hv-cinder-83705 Apr 08 02:49:47.304778 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-79dc7ff1-5421-41fa-9de6-0c11a4fdd30a req-e0de809f-fef0-403d-a139-edf760b07d70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100353 Apr 08 02:49:47.305386 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 202/419] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:49:48.300227 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1b193c9b-5519-42d6-bc0c-cdeb98dfebe6 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:48.300841 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1b193c9b-5519-42d6-bc0c-cdeb98dfebe6 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:48.308546 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1b193c9b-5519-42d6-bc0c-cdeb98dfebe6 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:48.309059 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1b193c9b-5519-42d6-bc0c-cdeb98dfebe6 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:48.309879 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1b193c9b-5519-42d6-bc0c-cdeb98dfebe6 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:48.310312 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1b193c9b-5519-42d6-bc0c-cdeb98dfebe6 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:48.573779 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1b193c9b-5519-42d6-bc0c-cdeb98dfebe6 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:48.583608 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1b193c9b-5519-42d6-bc0c-cdeb98dfebe6 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:48.585168 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1b193c9b-5519-42d6-bc0c-cdeb98dfebe6 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:48.586305 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1b193c9b-5519-42d6-bc0c-cdeb98dfebe6 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.289822 Apr 08 02:49:48.586863 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 218/420] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:48 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:49.605924 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4b5e61a5-be37-41ca-94c8-f260e72ccefe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:49.607075 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-4b5e61a5-be37-41ca-94c8-f260e72ccefe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:49.615454 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4b5e61a5-be37-41ca-94c8-f260e72ccefe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:49.616021 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4b5e61a5-be37-41ca-94c8-f260e72ccefe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:49.616798 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4b5e61a5-be37-41ca-94c8-f260e72ccefe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:49.617230 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4b5e61a5-be37-41ca-94c8-f260e72ccefe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:49.873914 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4b5e61a5-be37-41ca-94c8-f260e72ccefe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:49.884192 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4b5e61a5-be37-41ca-94c8-f260e72ccefe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:49.885708 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4b5e61a5-be37-41ca-94c8-f260e72ccefe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:49.886844 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4b5e61a5-be37-41ca-94c8-f260e72ccefe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.285616 Apr 08 02:49:49.887395 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 203/421] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:49 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:50.906166 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0965460f-2afe-4459-81c1-18b032958e8f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:50.906772 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0965460f-2afe-4459-81c1-18b032958e8f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:50.914751 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0965460f-2afe-4459-81c1-18b032958e8f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:50.915196 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0965460f-2afe-4459-81c1-18b032958e8f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:50.915972 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0965460f-2afe-4459-81c1-18b032958e8f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:50.916411 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0965460f-2afe-4459-81c1-18b032958e8f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:51.124781 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0965460f-2afe-4459-81c1-18b032958e8f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:51.133913 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0965460f-2afe-4459-81c1-18b032958e8f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:51.135416 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0965460f-2afe-4459-81c1-18b032958e8f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:51.136590 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0965460f-2afe-4459-81c1-18b032958e8f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.234125 Apr 08 02:49:51.137142 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 219/422] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:50 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:52.155914 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-85b62814-42c4-4717-9ed1-eb3f43b5e2e8 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:52.156718 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-85b62814-42c4-4717-9ed1-eb3f43b5e2e8 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:52.165353 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-85b62814-42c4-4717-9ed1-eb3f43b5e2e8 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:52.165760 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-85b62814-42c4-4717-9ed1-eb3f43b5e2e8 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:52.166486 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-85b62814-42c4-4717-9ed1-eb3f43b5e2e8 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:52.166906 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-85b62814-42c4-4717-9ed1-eb3f43b5e2e8 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:52.368255 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-85b62814-42c4-4717-9ed1-eb3f43b5e2e8 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:52.377311 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-85b62814-42c4-4717-9ed1-eb3f43b5e2e8 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:52.379304 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-85b62814-42c4-4717-9ed1-eb3f43b5e2e8 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:52.381091 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-85b62814-42c4-4717-9ed1-eb3f43b5e2e8 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1808 microversion: 2.20 time: 0.229424 Apr 08 02:49:52.381641 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 204/423] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:52 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:53.399050 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-a6e3bd28-f51b-4a48-a1b1-cd9552c84c18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:53.399646 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-a6e3bd28-f51b-4a48-a1b1-cd9552c84c18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:53.407011 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a6e3bd28-f51b-4a48-a1b1-cd9552c84c18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:53.407462 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a6e3bd28-f51b-4a48-a1b1-cd9552c84c18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:53.408253 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a6e3bd28-f51b-4a48-a1b1-cd9552c84c18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:53.408690 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a6e3bd28-f51b-4a48-a1b1-cd9552c84c18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:53.603861 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a6e3bd28-f51b-4a48-a1b1-cd9552c84c18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:53.612925 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a6e3bd28-f51b-4a48-a1b1-cd9552c84c18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:53.614576 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a6e3bd28-f51b-4a48-a1b1-cd9552c84c18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:53.615822 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-a6e3bd28-f51b-4a48-a1b1-cd9552c84c18 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1795 microversion: 2.20 time: 0.221133 Apr 08 02:49:53.616449 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 220/424] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:53 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1795 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:53.738526 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-33aa41f8-71ad-4983-ae8e-477f604bbe5c tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:53.739021 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-33aa41f8-71ad-4983-ae8e-477f604bbe5c tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:53.746433 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-33aa41f8-71ad-4983-ae8e-477f604bbe5c tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:53.746884 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-33aa41f8-71ad-4983-ae8e-477f604bbe5c tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:53.747650 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-33aa41f8-71ad-4983-ae8e-477f604bbe5c tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:53.748126 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-33aa41f8-71ad-4983-ae8e-477f604bbe5c tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:53.893703 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.objects.instance [None req-33aa41f8-71ad-4983-ae8e-477f604bbe5c tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lazy-loading 'services' on Instance uuid 243402df-e2d8-46e4-9166-6762c267291f {{(pid=101271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:49:54.041291 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-33aa41f8-71ad-4983-ae8e-477f604bbe5c tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "DELETE /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f/os-volume_attachments/e22fc030-ac36-467c-aab8-675214a16927" status: 202 len: 0 microversion: 2.1 time: 0.306320 Apr 08 02:49:54.041902 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 205/425] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Apr 8 02:49:53 2022] DELETE /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f/os-volume_attachments/e22fc030-ac36-467c-aab8-675214a16927 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:49:56.298165 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e5bc86bf-259d-4cd0-8987-e58f68532ba7 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:56.298717 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e5bc86bf-259d-4cd0-8987-e58f68532ba7 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:56.306922 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e5bc86bf-259d-4cd0-8987-e58f68532ba7 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:56.307363 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e5bc86bf-259d-4cd0-8987-e58f68532ba7 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:56.308165 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e5bc86bf-259d-4cd0-8987-e58f68532ba7 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:56.308594 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e5bc86bf-259d-4cd0-8987-e58f68532ba7 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:56.369990 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e5bc86bf-259d-4cd0-8987-e58f68532ba7 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Going to try to terminate instance {{(pid=101272) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:49:56.482518 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e5bc86bf-259d-4cd0-8987-e58f68532ba7 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "DELETE /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 204 len: 0 microversion: 2.1 time: 0.187688 Apr 08 02:49:56.483031 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 221/426] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:49:56 2022] DELETE /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:49:56.492294 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5a5cf370-b228-44db-a739-c4cef53f3f31 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:56.493116 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-5a5cf370-b228-44db-a739-c4cef53f3f31 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:56.500757 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5a5cf370-b228-44db-a739-c4cef53f3f31 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:56.501211 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5a5cf370-b228-44db-a739-c4cef53f3f31 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:56.501983 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5a5cf370-b228-44db-a739-c4cef53f3f31 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:56.502419 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5a5cf370-b228-44db-a739-c4cef53f3f31 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:56.700648 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5a5cf370-b228-44db-a739-c4cef53f3f31 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:56.708967 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-5a5cf370-b228-44db-a739-c4cef53f3f31 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1514 microversion: 2.1 time: 0.221498 Apr 08 02:49:56.709526 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 206/427] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:56 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:57.727419 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f5779d74-587e-4108-895d-73d421076c2b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:57.728134 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f5779d74-587e-4108-895d-73d421076c2b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:57.735328 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f5779d74-587e-4108-895d-73d421076c2b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:57.735771 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f5779d74-587e-4108-895d-73d421076c2b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:57.736563 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f5779d74-587e-4108-895d-73d421076c2b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:57.736994 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f5779d74-587e-4108-895d-73d421076c2b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:57.928546 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f5779d74-587e-4108-895d-73d421076c2b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:57.936641 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f5779d74-587e-4108-895d-73d421076c2b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1514 microversion: 2.1 time: 0.214428 Apr 08 02:49:57.937199 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 222/428] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:57 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1514 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:58.953400 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-9b07d2cc-e748-4332-9419-c15a603baab1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:58.954038 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-9b07d2cc-e748-4332-9419-c15a603baab1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:49:58.961285 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9b07d2cc-e748-4332-9419-c15a603baab1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:58.961844 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9b07d2cc-e748-4332-9419-c15a603baab1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:58.962615 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9b07d2cc-e748-4332-9419-c15a603baab1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:58.963048 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9b07d2cc-e748-4332-9419-c15a603baab1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:59.157506 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-9b07d2cc-e748-4332-9419-c15a603baab1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:49:59.166235 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-9b07d2cc-e748-4332-9419-c15a603baab1 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1514 microversion: 2.1 time: 0.216518 Apr 08 02:49:59.166790 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 207/429] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:58 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:59.658043 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-23cabf7e-88b1-4be8-abed-0d013fc254b6 req-7c45918b-72b9-4ce6-8bc0-ebe3475ea52e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243402df-e2d8-46e4-9166-6762c267291f", "name": "network-vif-deleted", "tag": "6f01f6ba-057e-4a68-b3cf-b0a236ca6707"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:59.659635 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:49:59.659635 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:49:59.668261 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-23cabf7e-88b1-4be8-abed-0d013fc254b6 req-7c45918b-72b9-4ce6-8bc0-ebe3475ea52e service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:59.668713 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-23cabf7e-88b1-4be8-abed-0d013fc254b6 req-7c45918b-72b9-4ce6-8bc0-ebe3475ea52e service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:59.684516 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-23cabf7e-88b1-4be8-abed-0d013fc254b6 req-7c45918b-72b9-4ce6-8bc0-ebe3475ea52e service nova] Creating event network-vif-deleted:6f01f6ba-057e-4a68-b3cf-b0a236ca6707 for instance 243402df-e2d8-46e4-9166-6762c267291f on hv-cinder-83705 Apr 08 02:49:59.689146 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-23cabf7e-88b1-4be8-abed-0d013fc254b6 req-7c45918b-72b9-4ce6-8bc0-ebe3475ea52e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098347 Apr 08 02:49:59.689789 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 223/430] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:50:00.183818 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-249b74b9-2ebf-48ff-b4a7-074d0402d52b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:00.184468 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-249b74b9-2ebf-48ff-b4a7-074d0402d52b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:00.191625 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-249b74b9-2ebf-48ff-b4a7-074d0402d52b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:00.192120 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-249b74b9-2ebf-48ff-b4a7-074d0402d52b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:00.193624 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-249b74b9-2ebf-48ff-b4a7-074d0402d52b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:00.194061 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-249b74b9-2ebf-48ff-b4a7-074d0402d52b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:00.263742 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-249b74b9-2ebf-48ff-b4a7-074d0402d52b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:00.264225 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-249b74b9-2ebf-48ff-b4a7-074d0402d52b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:00.264684 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.objects.instance [None req-249b74b9-2ebf-48ff-b4a7-074d0402d52b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lazy-loading 'fault' on Instance uuid 243402df-e2d8-46e4-9166-6762c267291f {{(pid=101271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:50:00.323215 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-249b74b9-2ebf-48ff-b4a7-074d0402d52b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c93aa211c4587a97533f4b4e50b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f648ffbed31f4192b6f16124451b3559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:00.336950 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-249b74b9-2ebf-48ff-b4a7-074d0402d52b tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 200 len: 1309 microversion: 2.1 time: 0.156549 Apr 08 02:50:00.337984 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 208/431] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:00 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 1309 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:01.354894 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-674caaf2-d44b-4679-8e07-81131436d4f2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:01.355583 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-674caaf2-d44b-4679-8e07-81131436d4f2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] [instance: 243402df-e2d8-46e4-9166-6762c267291f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:01.363036 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-674caaf2-d44b-4679-8e07-81131436d4f2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:01.363481 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-674caaf2-d44b-4679-8e07-81131436d4f2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:01.364277 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-674caaf2-d44b-4679-8e07-81131436d4f2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:01.364711 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-674caaf2-d44b-4679-8e07-81131436d4f2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:01.413624 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-674caaf2-d44b-4679-8e07-81131436d4f2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] HTTP exception thrown: Instance 243402df-e2d8-46e4-9166-6762c267291f could not be found. Apr 08 02:50:01.414205 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-674caaf2-d44b-4679-8e07-81131436d4f2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] Returning 404 to user: Instance 243402df-e2d8-46e4-9166-6762c267291f could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:50:01.415005 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-674caaf2-d44b-4679-8e07-81131436d4f2 tempest-VolumesSnapshotTestJSON-2014791461 tempest-VolumesSnapshotTestJSON-2014791461-project] 10.222.0.23 "GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f" status: 404 len: 111 microversion: 2.1 time: 0.064243 Apr 08 02:50:01.415532 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 224/432] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:01 2022] GET /compute/v2.1/servers/243402df-e2d8-46e4-9166-6762c267291f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:50:09.088149 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ad1b2f67-a807-446b-9dc3-37e793253e5d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f1b9b51-a546-4f36-8da5-03fc03d16ccf"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:09.089263 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ad1b2f67-a807-446b-9dc3-37e793253e5d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:09.096503 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ad1b2f67-a807-446b-9dc3-37e793253e5d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:09.096995 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ad1b2f67-a807-446b-9dc3-37e793253e5d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:09.097751 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ad1b2f67-a807-446b-9dc3-37e793253e5d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:09.098180 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ad1b2f67-a807-446b-9dc3-37e793253e5d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:09.470767 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ad1b2f67-a807-446b-9dc3-37e793253e5d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "POST /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386134 Apr 08 02:50:09.471380 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 209/433] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Apr 8 02:50:09 2022] POST /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:50:19.414586 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b42fcba2-aaae-43fc-b1cd-19ed9bbfc2e6 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:19.415534 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b42fcba2-aaae-43fc-b1cd-19ed9bbfc2e6 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:19.422698 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b42fcba2-aaae-43fc-b1cd-19ed9bbfc2e6 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:19.423149 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b42fcba2-aaae-43fc-b1cd-19ed9bbfc2e6 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:19.423918 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b42fcba2-aaae-43fc-b1cd-19ed9bbfc2e6 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:19.424380 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b42fcba2-aaae-43fc-b1cd-19ed9bbfc2e6 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:19.482637 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.objects.instance [None req-b42fcba2-aaae-43fc-b1cd-19ed9bbfc2e6 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lazy-loading 'flavor' on Instance uuid 06827ced-06c8-40dd-9ad3-3b5d02590d00 {{(pid=101272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:50:19.712725 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b42fcba2-aaae-43fc-b1cd-19ed9bbfc2e6 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "POST /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/action" status: 200 len: 32 microversion: 2.1 time: 0.302264 Apr 08 02:50:19.713330 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 225/434] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Apr 8 02:50:19 2022] POST /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/action => generated 32 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:50:19.723644 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-9654c43f-17d0-4d86-b841-96564f244bde tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:19.724701 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-9654c43f-17d0-4d86-b841-96564f244bde tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:19.733717 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9654c43f-17d0-4d86-b841-96564f244bde tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:19.734272 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9654c43f-17d0-4d86-b841-96564f244bde tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:19.735251 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9654c43f-17d0-4d86-b841-96564f244bde tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:19.735971 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9654c43f-17d0-4d86-b841-96564f244bde tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:19.964820 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-9654c43f-17d0-4d86-b841-96564f244bde tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:19.974688 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-9654c43f-17d0-4d86-b841-96564f244bde tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1737 microversion: 2.1 time: 0.255778 Apr 08 02:50:19.984765 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 210/435] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:19 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1737 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:20.993629 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-de87d54f-f346-4088-9b82-b603ca29da41 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:20.994188 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-de87d54f-f346-4088-9b82-b603ca29da41 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:21.001464 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-de87d54f-f346-4088-9b82-b603ca29da41 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:21.001956 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-de87d54f-f346-4088-9b82-b603ca29da41 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:21.002719 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-de87d54f-f346-4088-9b82-b603ca29da41 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:21.003151 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-de87d54f-f346-4088-9b82-b603ca29da41 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:21.208614 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-de87d54f-f346-4088-9b82-b603ca29da41 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:21.217218 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-de87d54f-f346-4088-9b82-b603ca29da41 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1737 microversion: 2.1 time: 0.228813 Apr 08 02:50:21.217782 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 226/436] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:20 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:22.340593 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-240daaa6-0cd4-4d2a-90ea-a956fd45567d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:22.341291 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-240daaa6-0cd4-4d2a-90ea-a956fd45567d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:22.349872 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-240daaa6-0cd4-4d2a-90ea-a956fd45567d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:22.350355 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-240daaa6-0cd4-4d2a-90ea-a956fd45567d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:22.351136 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-240daaa6-0cd4-4d2a-90ea-a956fd45567d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:22.351582 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-240daaa6-0cd4-4d2a-90ea-a956fd45567d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:22.547320 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-240daaa6-0cd4-4d2a-90ea-a956fd45567d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:22.556616 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-240daaa6-0cd4-4d2a-90ea-a956fd45567d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1737 microversion: 2.1 time: 0.325662 Apr 08 02:50:22.557181 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 211/437] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:22 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1737 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:23.573656 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e57f7aec-fe90-42cb-b9ea-c2f24f80da7a tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:23.574274 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e57f7aec-fe90-42cb-b9ea-c2f24f80da7a tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:23.581446 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e57f7aec-fe90-42cb-b9ea-c2f24f80da7a tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:23.581887 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e57f7aec-fe90-42cb-b9ea-c2f24f80da7a tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:23.582646 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e57f7aec-fe90-42cb-b9ea-c2f24f80da7a tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:23.583104 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e57f7aec-fe90-42cb-b9ea-c2f24f80da7a tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:23.780653 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e57f7aec-fe90-42cb-b9ea-c2f24f80da7a tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:23.789628 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e57f7aec-fe90-42cb-b9ea-c2f24f80da7a tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1737 microversion: 2.1 time: 0.219676 Apr 08 02:50:23.790190 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 227/438] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:23 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:24.806838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-9a82372b-b4c3-4d60-9ba1-95b6523fcf89 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:24.807548 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-9a82372b-b4c3-4d60-9ba1-95b6523fcf89 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:24.814732 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9a82372b-b4c3-4d60-9ba1-95b6523fcf89 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:24.815247 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9a82372b-b4c3-4d60-9ba1-95b6523fcf89 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:24.816107 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9a82372b-b4c3-4d60-9ba1-95b6523fcf89 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:24.816627 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9a82372b-b4c3-4d60-9ba1-95b6523fcf89 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:25.014337 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-9a82372b-b4c3-4d60-9ba1-95b6523fcf89 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:25.023446 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-9a82372b-b4c3-4d60-9ba1-95b6523fcf89 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1737 microversion: 2.1 time: 0.221661 Apr 08 02:50:25.024024 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 212/439] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:24 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:26.041584 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1471fd5b-5aaa-4077-8ead-a66605ca9144 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:26.042418 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1471fd5b-5aaa-4077-8ead-a66605ca9144 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:26.049644 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1471fd5b-5aaa-4077-8ead-a66605ca9144 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:26.050090 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1471fd5b-5aaa-4077-8ead-a66605ca9144 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:26.050880 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1471fd5b-5aaa-4077-8ead-a66605ca9144 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:26.051309 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1471fd5b-5aaa-4077-8ead-a66605ca9144 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:26.397662 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1471fd5b-5aaa-4077-8ead-a66605ca9144 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:26.406138 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1471fd5b-5aaa-4077-8ead-a66605ca9144 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1737 microversion: 2.1 time: 0.368776 Apr 08 02:50:26.406687 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 228/440] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:26 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1737 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:27.422331 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c1fc5f1e-f38d-4d00-a3ae-cf4af68e3477 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:27.422946 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c1fc5f1e-f38d-4d00-a3ae-cf4af68e3477 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:27.431013 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c1fc5f1e-f38d-4d00-a3ae-cf4af68e3477 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:27.431501 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c1fc5f1e-f38d-4d00-a3ae-cf4af68e3477 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:27.432298 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c1fc5f1e-f38d-4d00-a3ae-cf4af68e3477 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:27.432778 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c1fc5f1e-f38d-4d00-a3ae-cf4af68e3477 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:27.635487 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c1fc5f1e-f38d-4d00-a3ae-cf4af68e3477 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:27.645012 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c1fc5f1e-f38d-4d00-a3ae-cf4af68e3477 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1737 microversion: 2.1 time: 0.226281 Apr 08 02:50:27.646226 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 213/441] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:27 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1737 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:28.428988 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-31b85c20-f4bc-4a9c-9053-a14e21f59f27 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:28.429490 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-31b85c20-f4bc-4a9c-9053-a14e21f59f27 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:28.436741 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-31b85c20-f4bc-4a9c-9053-a14e21f59f27 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:28.437225 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-31b85c20-f4bc-4a9c-9053-a14e21f59f27 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:28.438001 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-31b85c20-f4bc-4a9c-9053-a14e21f59f27 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:28.438444 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-31b85c20-f4bc-4a9c-9053-a14e21f59f27 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:28.587693 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.objects.instance [None req-31b85c20-f4bc-4a9c-9053-a14e21f59f27 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lazy-loading 'services' on Instance uuid ff7e510d-5c97-4291-930a-66cd4b8d6137 {{(pid=101272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:50:28.664838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-eb26923f-9191-4ca4-aa0f-8266924e4993 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:28.665642 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-eb26923f-9191-4ca4-aa0f-8266924e4993 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:28.673158 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-eb26923f-9191-4ca4-aa0f-8266924e4993 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:28.673683 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-eb26923f-9191-4ca4-aa0f-8266924e4993 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:28.674528 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-eb26923f-9191-4ca4-aa0f-8266924e4993 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:28.675036 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-eb26923f-9191-4ca4-aa0f-8266924e4993 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:28.734940 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-31b85c20-f4bc-4a9c-9053-a14e21f59f27 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/os-volume_attachments/d72fce49-f1f5-4361-9521-d2c0ea63448f" status: 202 len: 0 microversion: 2.1 time: 0.412013 Apr 08 02:50:28.738709 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 229/442] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Apr 8 02:50:28 2022] DELETE /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/os-volume_attachments/d72fce49-f1f5-4361-9521-d2c0ea63448f => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:50:28.894801 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-eb26923f-9191-4ca4-aa0f-8266924e4993 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:28.904324 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-eb26923f-9191-4ca4-aa0f-8266924e4993 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1737 microversion: 2.1 time: 0.243741 Apr 08 02:50:28.904902 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 214/443] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:28 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1737 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:29.922313 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1546368a-02d2-40a0-9775-f4bc242379d3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:29.922994 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1546368a-02d2-40a0-9775-f4bc242379d3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:29.930972 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1546368a-02d2-40a0-9775-f4bc242379d3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:29.931424 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1546368a-02d2-40a0-9775-f4bc242379d3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:29.931549 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-7a24dd84-e98d-46f4-9b58-54ed6ea823b8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:29.932569 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1546368a-02d2-40a0-9775-f4bc242379d3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:29.932692 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1546368a-02d2-40a0-9775-f4bc242379d3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:29.939489 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7a24dd84-e98d-46f4-9b58-54ed6ea823b8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:29.939964 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7a24dd84-e98d-46f4-9b58-54ed6ea823b8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:29.998452 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-7a24dd84-e98d-46f4-9b58-54ed6ea823b8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Going to try to stop instance {{(pid=101271) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Apr 08 02:50:30.084218 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-7a24dd84-e98d-46f4-9b58-54ed6ea823b8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "POST /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/action" status: 202 len: 0 microversion: 2.1 time: 0.157331 Apr 08 02:50:30.085479 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 215/444] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Apr 8 02:50:29 2022] POST /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 02:50:30.098925 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-82b4e5bc-d213-4ad3-abaa-e7db54fcfc0f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:30.100259 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-82b4e5bc-d213-4ad3-abaa-e7db54fcfc0f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:30.112314 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-82b4e5bc-d213-4ad3-abaa-e7db54fcfc0f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:30.112763 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-82b4e5bc-d213-4ad3-abaa-e7db54fcfc0f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:30.113531 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-82b4e5bc-d213-4ad3-abaa-e7db54fcfc0f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:30.114497 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-82b4e5bc-d213-4ad3-abaa-e7db54fcfc0f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:30.146222 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1546368a-02d2-40a0-9775-f4bc242379d3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:30.155254 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1546368a-02d2-40a0-9775-f4bc242379d3 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1737 microversion: 2.1 time: 0.236921 Apr 08 02:50:30.156253 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 230/445] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:29 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1737 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:30.322630 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-82b4e5bc-d213-4ad3-abaa-e7db54fcfc0f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:30.331795 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-82b4e5bc-d213-4ad3-abaa-e7db54fcfc0f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1675 microversion: 2.1 time: 0.239230 Apr 08 02:50:30.332735 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 216/446] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:30 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1675 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:31.172267 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3640c040-e84d-440d-9405-5a33b6a95b85 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:31.172884 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-3640c040-e84d-440d-9405-5a33b6a95b85 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:31.180350 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3640c040-e84d-440d-9405-5a33b6a95b85 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:31.180797 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3640c040-e84d-440d-9405-5a33b6a95b85 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:31.181566 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3640c040-e84d-440d-9405-5a33b6a95b85 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:31.182000 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3640c040-e84d-440d-9405-5a33b6a95b85 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:31.349706 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f5702538-10a6-4313-81f8-b13445a2eedf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:31.350470 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f5702538-10a6-4313-81f8-b13445a2eedf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:31.358197 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f5702538-10a6-4313-81f8-b13445a2eedf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:31.359015 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f5702538-10a6-4313-81f8-b13445a2eedf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:31.359880 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f5702538-10a6-4313-81f8-b13445a2eedf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:31.360423 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f5702538-10a6-4313-81f8-b13445a2eedf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:31.380209 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-3640c040-e84d-440d-9405-5a33b6a95b85 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:31.389584 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3640c040-e84d-440d-9405-5a33b6a95b85 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1737 microversion: 2.1 time: 0.220927 Apr 08 02:50:31.390459 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 231/447] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:31 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:31.601162 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f5702538-10a6-4313-81f8-b13445a2eedf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:31.610008 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f5702538-10a6-4313-81f8-b13445a2eedf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1675 microversion: 2.1 time: 0.264299 Apr 08 02:50:31.611177 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 217/448] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:31 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1675 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:32.409098 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-8c7ec44e-318e-4ea9-9142-1f53e874dfb4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:32.410353 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-8c7ec44e-318e-4ea9-9142-1f53e874dfb4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:32.419705 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8c7ec44e-318e-4ea9-9142-1f53e874dfb4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:32.420187 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8c7ec44e-318e-4ea9-9142-1f53e874dfb4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:32.420995 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8c7ec44e-318e-4ea9-9142-1f53e874dfb4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:32.421612 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8c7ec44e-318e-4ea9-9142-1f53e874dfb4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:32.628444 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5250055a-d8ed-4d59-9fcc-1fe7b7a4dbb6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:32.628906 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-5250055a-d8ed-4d59-9fcc-1fe7b7a4dbb6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:32.638892 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5250055a-d8ed-4d59-9fcc-1fe7b7a4dbb6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:32.639205 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5250055a-d8ed-4d59-9fcc-1fe7b7a4dbb6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:32.640134 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5250055a-d8ed-4d59-9fcc-1fe7b7a4dbb6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:32.640514 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5250055a-d8ed-4d59-9fcc-1fe7b7a4dbb6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:32.770571 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-8c7ec44e-318e-4ea9-9142-1f53e874dfb4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:32.779863 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-8c7ec44e-318e-4ea9-9142-1f53e874dfb4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1737 microversion: 2.1 time: 0.375606 Apr 08 02:50:32.781048 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 232/449] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:32 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1737 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:32.898791 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5250055a-d8ed-4d59-9fcc-1fe7b7a4dbb6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:32.908105 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-5250055a-d8ed-4d59-9fcc-1fe7b7a4dbb6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1675 microversion: 2.1 time: 0.283402 Apr 08 02:50:32.914127 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 218/450] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:32 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1675 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:33.797415 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-bc69d0cb-ec18-4837-b47d-268e3bf16755 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:33.798692 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-bc69d0cb-ec18-4837-b47d-268e3bf16755 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:33.810194 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bc69d0cb-ec18-4837-b47d-268e3bf16755 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:33.810646 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bc69d0cb-ec18-4837-b47d-268e3bf16755 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:33.811639 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bc69d0cb-ec18-4837-b47d-268e3bf16755 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:33.812131 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bc69d0cb-ec18-4837-b47d-268e3bf16755 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:33.927106 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ca60939b-90ce-4f20-95f7-d8ac6046dbf5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:33.927796 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ca60939b-90ce-4f20-95f7-d8ac6046dbf5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:33.935434 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ca60939b-90ce-4f20-95f7-d8ac6046dbf5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:33.935886 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ca60939b-90ce-4f20-95f7-d8ac6046dbf5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:33.937010 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ca60939b-90ce-4f20-95f7-d8ac6046dbf5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:33.937456 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ca60939b-90ce-4f20-95f7-d8ac6046dbf5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:34.139346 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ca60939b-90ce-4f20-95f7-d8ac6046dbf5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:34.149157 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ca60939b-90ce-4f20-95f7-d8ac6046dbf5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1675 microversion: 2.1 time: 0.226289 Apr 08 02:50:34.150074 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 219/451] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:33 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1675 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:34.164297 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-bc69d0cb-ec18-4837-b47d-268e3bf16755 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:34.172823 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-bc69d0cb-ec18-4837-b47d-268e3bf16755 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1737 microversion: 2.1 time: 0.379138 Apr 08 02:50:34.173372 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 233/452] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:33 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1737 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:35.170208 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-23d09648-d614-4b94-a09c-e5c416931977 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:35.171581 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-23d09648-d614-4b94-a09c-e5c416931977 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:35.180423 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23d09648-d614-4b94-a09c-e5c416931977 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:35.181027 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23d09648-d614-4b94-a09c-e5c416931977 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:35.181881 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23d09648-d614-4b94-a09c-e5c416931977 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:35.182503 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23d09648-d614-4b94-a09c-e5c416931977 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:35.189953 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-a38b75b9-60ed-4df6-b633-9f63ffa8b562 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:35.190614 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-a38b75b9-60ed-4df6-b633-9f63ffa8b562 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:35.198775 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a38b75b9-60ed-4df6-b633-9f63ffa8b562 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:35.199457 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a38b75b9-60ed-4df6-b633-9f63ffa8b562 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:35.200454 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a38b75b9-60ed-4df6-b633-9f63ffa8b562 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:35.201048 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a38b75b9-60ed-4df6-b633-9f63ffa8b562 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:35.417912 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-23d09648-d614-4b94-a09c-e5c416931977 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:35.427173 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-23d09648-d614-4b94-a09c-e5c416931977 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1675 microversion: 2.1 time: 0.260537 Apr 08 02:50:35.427968 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 220/453] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:35 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1675 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:35.771560 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a38b75b9-60ed-4df6-b633-9f63ffa8b562 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:35.781267 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-a38b75b9-60ed-4df6-b633-9f63ffa8b562 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1737 microversion: 2.1 time: 0.595369 Apr 08 02:50:35.781976 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 234/454] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:35 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1737 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:36.447588 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f91924fa-408a-4928-b562-745f0711c982 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:36.454447 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f91924fa-408a-4928-b562-745f0711c982 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:36.478760 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f91924fa-408a-4928-b562-745f0711c982 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:36.479209 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f91924fa-408a-4928-b562-745f0711c982 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:36.481037 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f91924fa-408a-4928-b562-745f0711c982 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:36.481494 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f91924fa-408a-4928-b562-745f0711c982 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:36.798812 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f91924fa-408a-4928-b562-745f0711c982 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:36.801149 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-82566631-abc7-4fea-93ba-c334c57ec6e8 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:36.809619 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-82566631-abc7-4fea-93ba-c334c57ec6e8 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:36.815596 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f91924fa-408a-4928-b562-745f0711c982 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1675 microversion: 2.1 time: 0.371805 Apr 08 02:50:36.816231 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 221/455] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:36 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1675 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:36.825027 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-82566631-abc7-4fea-93ba-c334c57ec6e8 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:36.826031 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-82566631-abc7-4fea-93ba-c334c57ec6e8 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:36.830553 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-82566631-abc7-4fea-93ba-c334c57ec6e8 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:36.831490 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-82566631-abc7-4fea-93ba-c334c57ec6e8 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:37.256778 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-82566631-abc7-4fea-93ba-c334c57ec6e8 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:37.265721 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-82566631-abc7-4fea-93ba-c334c57ec6e8 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1737 microversion: 2.1 time: 0.468098 Apr 08 02:50:37.266523 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 235/456] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:36 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1737 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:37.833141 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-3d707eea-fb78-4b15-b961-0cd100abf37d tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:37.833775 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-3d707eea-fb78-4b15-b961-0cd100abf37d tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:37.843465 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3d707eea-fb78-4b15-b961-0cd100abf37d tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:37.844287 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3d707eea-fb78-4b15-b961-0cd100abf37d tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:37.844719 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3d707eea-fb78-4b15-b961-0cd100abf37d tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:37.845150 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3d707eea-fb78-4b15-b961-0cd100abf37d tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:38.064642 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3d707eea-fb78-4b15-b961-0cd100abf37d tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:38.085948 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-3d707eea-fb78-4b15-b961-0cd100abf37d tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1675 microversion: 2.1 time: 0.256093 Apr 08 02:50:38.086819 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 222/457] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:37 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1675 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:38.289109 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b6ea67f3-cf4b-4a88-bd45-591c1d0be68f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:38.289726 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b6ea67f3-cf4b-4a88-bd45-591c1d0be68f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:38.321357 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b6ea67f3-cf4b-4a88-bd45-591c1d0be68f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:38.322119 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b6ea67f3-cf4b-4a88-bd45-591c1d0be68f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:38.323433 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b6ea67f3-cf4b-4a88-bd45-591c1d0be68f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:38.324057 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b6ea67f3-cf4b-4a88-bd45-591c1d0be68f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:38.565015 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b6ea67f3-cf4b-4a88-bd45-591c1d0be68f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:38.575895 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b6ea67f3-cf4b-4a88-bd45-591c1d0be68f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1737 microversion: 2.1 time: 0.290691 Apr 08 02:50:38.576568 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 236/458] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:38 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1737 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:39.104418 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e9e01e41-c887-47aa-a8a1-79fb029f4f8f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:39.106158 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e9e01e41-c887-47aa-a8a1-79fb029f4f8f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:39.114565 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e9e01e41-c887-47aa-a8a1-79fb029f4f8f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:39.115278 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e9e01e41-c887-47aa-a8a1-79fb029f4f8f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:39.116674 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e9e01e41-c887-47aa-a8a1-79fb029f4f8f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:39.117279 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e9e01e41-c887-47aa-a8a1-79fb029f4f8f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:39.369840 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e9e01e41-c887-47aa-a8a1-79fb029f4f8f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:39.378195 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e9e01e41-c887-47aa-a8a1-79fb029f4f8f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1675 microversion: 2.1 time: 0.277986 Apr 08 02:50:39.378892 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 223/459] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:39 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1675 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:39.593387 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1b35d853-6915-4d1b-89a9-295f55322531 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:39.594009 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1b35d853-6915-4d1b-89a9-295f55322531 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:39.601743 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1b35d853-6915-4d1b-89a9-295f55322531 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:39.602330 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1b35d853-6915-4d1b-89a9-295f55322531 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:39.603393 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1b35d853-6915-4d1b-89a9-295f55322531 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:39.603841 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1b35d853-6915-4d1b-89a9-295f55322531 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:40.062397 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1b35d853-6915-4d1b-89a9-295f55322531 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:40.073091 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1b35d853-6915-4d1b-89a9-295f55322531 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1737 microversion: 2.1 time: 0.483167 Apr 08 02:50:40.073961 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 237/460] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:39 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1737 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:40.397361 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b8f8bf86-1a18-4d12-b704-06b9d22f4e9a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:40.398035 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b8f8bf86-1a18-4d12-b704-06b9d22f4e9a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:40.405193 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b8f8bf86-1a18-4d12-b704-06b9d22f4e9a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:40.405700 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b8f8bf86-1a18-4d12-b704-06b9d22f4e9a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:40.406467 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b8f8bf86-1a18-4d12-b704-06b9d22f4e9a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:40.406890 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b8f8bf86-1a18-4d12-b704-06b9d22f4e9a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:40.625050 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b8f8bf86-1a18-4d12-b704-06b9d22f4e9a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:40.635034 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b8f8bf86-1a18-4d12-b704-06b9d22f4e9a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1675 microversion: 2.1 time: 0.242500 Apr 08 02:50:40.635610 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 224/461] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:40 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1675 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:41.093095 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-279dd34f-79bc-424f-806f-83e1387a51f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:41.094836 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-279dd34f-79bc-424f-806f-83e1387a51f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:41.127512 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-279dd34f-79bc-424f-806f-83e1387a51f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:41.128706 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-279dd34f-79bc-424f-806f-83e1387a51f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:41.131735 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-279dd34f-79bc-424f-806f-83e1387a51f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:41.132425 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-279dd34f-79bc-424f-806f-83e1387a51f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:41.595402 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-279dd34f-79bc-424f-806f-83e1387a51f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:41.607430 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-279dd34f-79bc-424f-806f-83e1387a51f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1717 microversion: 2.1 time: 0.519601 Apr 08 02:50:41.608010 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 238/462] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:41 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1717 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:41.652494 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-6368263a-ea98-446e-87ad-7772304f2f66 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:41.653701 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-6368263a-ea98-446e-87ad-7772304f2f66 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:41.668587 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6368263a-ea98-446e-87ad-7772304f2f66 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:41.671619 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6368263a-ea98-446e-87ad-7772304f2f66 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:41.672719 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6368263a-ea98-446e-87ad-7772304f2f66 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:41.674506 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6368263a-ea98-446e-87ad-7772304f2f66 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:41.785761 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-54ba65ef-466a-4cee-b213-ab1f48a42af5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:41.786259 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-54ba65ef-466a-4cee-b213-ab1f48a42af5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:41.801433 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-54ba65ef-466a-4cee-b213-ab1f48a42af5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:41.801879 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-54ba65ef-466a-4cee-b213-ab1f48a42af5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:41.802860 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-54ba65ef-466a-4cee-b213-ab1f48a42af5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:41.803711 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-54ba65ef-466a-4cee-b213-ab1f48a42af5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:41.988355 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d9fa6679-801e-426a-940e-b397a2917c18] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 08 02:50:41.991785 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-54ba65ef-466a-4cee-b213-ab1f48a42af5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] HTTP exception thrown: Cannot 'detach_volume' instance 06827ced-06c8-40dd-9ad3-3b5d02590d00 while it is in vm_state rescued Apr 08 02:50:41.992567 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-54ba65ef-466a-4cee-b213-ab1f48a42af5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Returning 409 to user: Cannot 'detach_volume' instance 06827ced-06c8-40dd-9ad3-3b5d02590d00 while it is in vm_state rescued {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:50:41.993602 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-54ba65ef-466a-4cee-b213-ab1f48a42af5 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "DELETE /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/os-volume_attachments/9f1b9b51-a546-4f36-8da5-03fc03d16ccf" status: 409 len: 152 microversion: 2.1 time: 0.211835 Apr 08 02:50:41.998041 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 239/463] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Apr 8 02:50:41 2022] DELETE /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/os-volume_attachments/9f1b9b51-a546-4f36-8da5-03fc03d16ccf => generated 152 bytes in 217 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 08 02:50:42.003136 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ff1757a5-4e30-4048-9fa9-d136aa7e6a20 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:42.003880 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ff1757a5-4e30-4048-9fa9-d136aa7e6a20 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:42.013797 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ff1757a5-4e30-4048-9fa9-d136aa7e6a20 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:42.014420 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ff1757a5-4e30-4048-9fa9-d136aa7e6a20 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:42.015493 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ff1757a5-4e30-4048-9fa9-d136aa7e6a20 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:42.016185 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ff1757a5-4e30-4048-9fa9-d136aa7e6a20 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:42.062463 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-6368263a-ea98-446e-87ad-7772304f2f66 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:42.074761 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-6368263a-ea98-446e-87ad-7772304f2f66 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1675 microversion: 2.1 time: 0.426053 Apr 08 02:50:42.075613 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 225/464] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:41 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1675 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:42.196881 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ff1757a5-4e30-4048-9fa9-d136aa7e6a20 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "POST /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/action" status: 202 len: 0 microversion: 2.1 time: 0.196853 Apr 08 02:50:42.201781 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 240/465] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Apr 8 02:50:41 2022] POST /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:50:42.206778 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ed491e01-5c17-4e24-97aa-0669620be37e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:42.208325 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ed491e01-5c17-4e24-97aa-0669620be37e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:42.220889 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ed491e01-5c17-4e24-97aa-0669620be37e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:42.227669 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ed491e01-5c17-4e24-97aa-0669620be37e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:42.228819 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ed491e01-5c17-4e24-97aa-0669620be37e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:42.229564 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ed491e01-5c17-4e24-97aa-0669620be37e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:42.840299 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ed491e01-5c17-4e24-97aa-0669620be37e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:42.856728 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ed491e01-5c17-4e24-97aa-0669620be37e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1725 microversion: 2.1 time: 0.649870 Apr 08 02:50:42.857277 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 226/466] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:42 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1725 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:43.093914 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5bd5ebb0-0d6f-4944-875e-917d4d8eabe4 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:43.094648 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5bd5ebb0-0d6f-4944-875e-917d4d8eabe4 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:43.120867 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO oslo.messaging._drivers.impl_rabbit [-] [d9fa6679-801e-426a-940e-b397a2917c18] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58540. Apr 08 02:50:43.123324 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5bd5ebb0-0d6f-4944-875e-917d4d8eabe4 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:43.123770 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5bd5ebb0-0d6f-4944-875e-917d4d8eabe4 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:43.125134 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5bd5ebb0-0d6f-4944-875e-917d4d8eabe4 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:43.136460 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5bd5ebb0-0d6f-4944-875e-917d4d8eabe4 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:43.618340 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5bd5ebb0-0d6f-4944-875e-917d4d8eabe4 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:43.639646 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5bd5ebb0-0d6f-4944-875e-917d4d8eabe4 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1675 microversion: 2.1 time: 0.549840 Apr 08 02:50:43.642391 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 241/467] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:43 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1675 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:43.875345 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-47c43c75-4bcf-4094-bb90-fb321a962a4f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:43.876668 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-47c43c75-4bcf-4094-bb90-fb321a962a4f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:43.890423 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-47c43c75-4bcf-4094-bb90-fb321a962a4f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:43.891175 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-47c43c75-4bcf-4094-bb90-fb321a962a4f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:43.892218 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-47c43c75-4bcf-4094-bb90-fb321a962a4f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:43.892871 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-47c43c75-4bcf-4094-bb90-fb321a962a4f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:44.449401 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-47c43c75-4bcf-4094-bb90-fb321a962a4f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:44.461211 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-47c43c75-4bcf-4094-bb90-fb321a962a4f tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1725 microversion: 2.1 time: 0.590109 Apr 08 02:50:44.462544 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 227/468] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:43 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1725 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:44.659037 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5549730e-d5f2-412f-868c-9e72c7a4f475 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:44.665236 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5549730e-d5f2-412f-868c-9e72c7a4f475 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:44.672879 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5549730e-d5f2-412f-868c-9e72c7a4f475 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:44.673331 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5549730e-d5f2-412f-868c-9e72c7a4f475 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:44.674525 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5549730e-d5f2-412f-868c-9e72c7a4f475 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:44.675137 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5549730e-d5f2-412f-868c-9e72c7a4f475 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:44.970433 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5549730e-d5f2-412f-868c-9e72c7a4f475 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:44.981638 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5549730e-d5f2-412f-868c-9e72c7a4f475 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1675 microversion: 2.1 time: 0.326186 Apr 08 02:50:44.982204 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 242/469] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:44 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1675 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:45.448752 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2ca3a3ca-3ed7-4533-89fe-f26f6fdb17f6 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Action: 'create', calling method: .version_select at 0x7fbc381c09d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-444463297"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:45.472483 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-2ca3a3ca-3ed7-4533-89fe-f26f6fdb17f6 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Getting quotas for project 0f7f360a7ebf4464b91dce9442330898. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:50:45.477490 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-2ca3a3ca-3ed7-4533-89fe-f26f6fdb17f6 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Getting quotas for user a0f675843ecb4ef2b4c1b450b6bacf88 and project 0f7f360a7ebf4464b91dce9442330898. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:50:45.478733 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f499d9ca-977e-4409-ac70-1f49ade3ceb7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:45.479462 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f499d9ca-977e-4409-ac70-1f49ade3ceb7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:45.493414 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f499d9ca-977e-4409-ac70-1f49ade3ceb7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:45.494247 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f499d9ca-977e-4409-ac70-1f49ade3ceb7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:45.495261 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f499d9ca-977e-4409-ac70-1f49ade3ceb7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:45.495957 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f499d9ca-977e-4409-ac70-1f49ade3ceb7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:45.728593 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f499d9ca-977e-4409-ac70-1f49ade3ceb7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:45.737417 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f499d9ca-977e-4409-ac70-1f49ade3ceb7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1725 microversion: 2.1 time: 0.262454 Apr 08 02:50:45.737980 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 243/470] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:45 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1725 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:45.772894 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-2ca3a3ca-3ed7-4533-89fe-f26f6fdb17f6 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Getting quotas for project 0f7f360a7ebf4464b91dce9442330898. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:50:45.776559 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-2ca3a3ca-3ed7-4533-89fe-f26f6fdb17f6 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Getting quotas for user a0f675843ecb4ef2b4c1b450b6bacf88 and project 0f7f360a7ebf4464b91dce9442330898. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:50:45.789795 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2ca3a3ca-3ed7-4533-89fe-f26f6fdb17f6 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.523549 Apr 08 02:50:45.790395 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 228/471] 10.222.0.23 () {60 vars in 1157 bytes} [Fri Apr 8 02:50:45 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:45.998840 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0e29327f-9d5b-420d-845c-9193d6628518 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:45.999448 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0e29327f-9d5b-420d-845c-9193d6628518 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:46.008079 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0e29327f-9d5b-420d-845c-9193d6628518 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:46.008526 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0e29327f-9d5b-420d-845c-9193d6628518 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:46.009292 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0e29327f-9d5b-420d-845c-9193d6628518 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:46.009723 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0e29327f-9d5b-420d-845c-9193d6628518 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:46.275442 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0e29327f-9d5b-420d-845c-9193d6628518 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:46.284643 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0e29327f-9d5b-420d-845c-9193d6628518 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1675 microversion: 2.1 time: 0.289322 Apr 08 02:50:46.285226 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 244/472] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:45 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1675 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:46.757081 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f3638a66-098e-4a66-bfec-c062d3067b7d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:46.758419 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f3638a66-098e-4a66-bfec-c062d3067b7d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:46.767409 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f3638a66-098e-4a66-bfec-c062d3067b7d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:46.768255 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f3638a66-098e-4a66-bfec-c062d3067b7d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:46.769238 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f3638a66-098e-4a66-bfec-c062d3067b7d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:46.769886 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f3638a66-098e-4a66-bfec-c062d3067b7d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:47.000297 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f3638a66-098e-4a66-bfec-c062d3067b7d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:47.011484 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f3638a66-098e-4a66-bfec-c062d3067b7d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1731 microversion: 2.1 time: 0.258602 Apr 08 02:50:47.011918 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 229/473] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:46 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1731 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:47.028093 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-03fbc462-5ee4-40b5-8587-c05c01fe4767 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:47.029154 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-03fbc462-5ee4-40b5-8587-c05c01fe4767 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:47.039002 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-03fbc462-5ee4-40b5-8587-c05c01fe4767 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:47.039657 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-03fbc462-5ee4-40b5-8587-c05c01fe4767 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:47.041000 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-03fbc462-5ee4-40b5-8587-c05c01fe4767 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:47.041754 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-03fbc462-5ee4-40b5-8587-c05c01fe4767 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:47.231668 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-03fbc462-5ee4-40b5-8587-c05c01fe4767 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.207624 Apr 08 02:50:47.239087 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 245/474] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Apr 8 02:50:47 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/os-interface => generated 285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:50:47.302746 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ded3a376-fc07-4b0e-b009-0e8d0ca2bfce tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:47.303246 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ded3a376-fc07-4b0e-b009-0e8d0ca2bfce tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:47.315114 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ded3a376-fc07-4b0e-b009-0e8d0ca2bfce tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:47.316460 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ded3a376-fc07-4b0e-b009-0e8d0ca2bfce tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:47.318114 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ded3a376-fc07-4b0e-b009-0e8d0ca2bfce tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:47.318734 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ded3a376-fc07-4b0e-b009-0e8d0ca2bfce tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:47.724445 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ded3a376-fc07-4b0e-b009-0e8d0ca2bfce tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:47.741109 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ded3a376-fc07-4b0e-b009-0e8d0ca2bfce tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1675 microversion: 2.1 time: 0.442003 Apr 08 02:50:47.743161 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 230/475] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:47 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1675 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:48.759215 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-575eb3f7-8654-46f5-a251-b5444ec9f79f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:48.759824 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-575eb3f7-8654-46f5-a251-b5444ec9f79f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:48.771237 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-575eb3f7-8654-46f5-a251-b5444ec9f79f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:48.771569 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-575eb3f7-8654-46f5-a251-b5444ec9f79f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:48.772841 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-575eb3f7-8654-46f5-a251-b5444ec9f79f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:48.774128 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-575eb3f7-8654-46f5-a251-b5444ec9f79f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:49.056582 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-575eb3f7-8654-46f5-a251-b5444ec9f79f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:49.073954 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-575eb3f7-8654-46f5-a251-b5444ec9f79f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1675 microversion: 2.1 time: 0.319022 Apr 08 02:50:49.079084 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 246/476] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:48 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1675 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:49.229696 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-74ae2cca-d4d0-4bb3-aa59-0b29c62161d0 req-4d85d17c-a46e-4fab-a4d5-82c77a2a23b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06827ced-06c8-40dd-9ad3-3b5d02590d00", "tag": "32e13942-1502-4bda-aca8-d69e5aacf04a"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:49.231601 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:50:49.231601 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:50:49.251809 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-74ae2cca-d4d0-4bb3-aa59-0b29c62161d0 req-4d85d17c-a46e-4fab-a4d5-82c77a2a23b6 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:49.252526 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-74ae2cca-d4d0-4bb3-aa59-0b29c62161d0 req-4d85d17c-a46e-4fab-a4d5-82c77a2a23b6 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:49.274282 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-74ae2cca-d4d0-4bb3-aa59-0b29c62161d0 req-4d85d17c-a46e-4fab-a4d5-82c77a2a23b6 service nova] Creating event network-changed:32e13942-1502-4bda-aca8-d69e5aacf04a for instance 06827ced-06c8-40dd-9ad3-3b5d02590d00 on hv-cinder-83705 Apr 08 02:50:49.279626 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-74ae2cca-d4d0-4bb3-aa59-0b29c62161d0 req-4d85d17c-a46e-4fab-a4d5-82c77a2a23b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163459 Apr 08 02:50:49.282646 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 231/477] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:50:50.100220 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2f658b4b-7926-4542-b21b-e34707968d93 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:50.101969 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2f658b4b-7926-4542-b21b-e34707968d93 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:50.111311 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2f658b4b-7926-4542-b21b-e34707968d93 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:50.112199 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2f658b4b-7926-4542-b21b-e34707968d93 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:50.113156 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2f658b4b-7926-4542-b21b-e34707968d93 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:50.113794 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2f658b4b-7926-4542-b21b-e34707968d93 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:50.375517 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2f658b4b-7926-4542-b21b-e34707968d93 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:50.384792 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2f658b4b-7926-4542-b21b-e34707968d93 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1675 microversion: 2.1 time: 0.289835 Apr 08 02:50:50.385359 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 247/478] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:50 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1675 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:51.294627 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-753647f4-afc7-46ce-955b-d610d38ebd10 req-b429ee65-0500-471a-bb53-fe71fefc5d3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06827ced-06c8-40dd-9ad3-3b5d02590d00", "tag": "32e13942-1502-4bda-aca8-d69e5aacf04a"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:51.296106 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:50:51.296106 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:50:51.304759 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-753647f4-afc7-46ce-955b-d610d38ebd10 req-b429ee65-0500-471a-bb53-fe71fefc5d3f service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:51.305197 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-753647f4-afc7-46ce-955b-d610d38ebd10 req-b429ee65-0500-471a-bb53-fe71fefc5d3f service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:51.320709 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-753647f4-afc7-46ce-955b-d610d38ebd10 req-b429ee65-0500-471a-bb53-fe71fefc5d3f service nova] Creating event network-changed:32e13942-1502-4bda-aca8-d69e5aacf04a for instance 06827ced-06c8-40dd-9ad3-3b5d02590d00 on hv-cinder-83705 Apr 08 02:50:51.325403 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-753647f4-afc7-46ce-955b-d610d38ebd10 req-b429ee65-0500-471a-bb53-fe71fefc5d3f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034955 Apr 08 02:50:51.325969 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 232/479] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:50:51.401691 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1d93120c-d12b-47dc-85b3-9708b32b4e12 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:51.402298 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1d93120c-d12b-47dc-85b3-9708b32b4e12 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:51.410317 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1d93120c-d12b-47dc-85b3-9708b32b4e12 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:51.411210 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1d93120c-d12b-47dc-85b3-9708b32b4e12 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:51.412793 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1d93120c-d12b-47dc-85b3-9708b32b4e12 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:51.413686 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1d93120c-d12b-47dc-85b3-9708b32b4e12 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:51.821045 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1d93120c-d12b-47dc-85b3-9708b32b4e12 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:51.829241 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1d93120c-d12b-47dc-85b3-9708b32b4e12 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1652 microversion: 2.1 time: 0.431292 Apr 08 02:50:51.830181 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 248/480] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:51 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1652 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:51.847399 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c6cb0bf1-f480-44d3-ab97-2a688627187e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:51.855524 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c6cb0bf1-f480-44d3-ab97-2a688627187e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:51.856068 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c6cb0bf1-f480-44d3-ab97-2a688627187e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:51.913392 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c6cb0bf1-f480-44d3-ab97-2a688627187e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Going to try to start instance {{(pid=101271) start /opt/stack/nova/nova/compute/api.py:2625}} Apr 08 02:50:51.992844 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c6cb0bf1-f480-44d3-ab97-2a688627187e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "POST /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/action" status: 202 len: 0 microversion: 2.1 time: 0.149392 Apr 08 02:50:51.993845 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 233/481] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Apr 8 02:50:51 2022] POST /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:50:52.001907 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ff1c2820-5794-4281-8b63-53e1bb49ee6e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:52.003235 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ff1c2820-5794-4281-8b63-53e1bb49ee6e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:52.011255 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ff1c2820-5794-4281-8b63-53e1bb49ee6e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:52.012016 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ff1c2820-5794-4281-8b63-53e1bb49ee6e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:52.012984 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ff1c2820-5794-4281-8b63-53e1bb49ee6e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:52.013431 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ff1c2820-5794-4281-8b63-53e1bb49ee6e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:52.334991 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ff1c2820-5794-4281-8b63-53e1bb49ee6e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:52.346067 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ff1c2820-5794-4281-8b63-53e1bb49ee6e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1661 microversion: 2.1 time: 0.348134 Apr 08 02:50:52.347000 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 249/482] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:51 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1661 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:53.364830 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b82b674a-00e1-46cc-abbe-e31d1bb951c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:53.365531 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b82b674a-00e1-46cc-abbe-e31d1bb951c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:53.373354 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b82b674a-00e1-46cc-abbe-e31d1bb951c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:53.373799 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b82b674a-00e1-46cc-abbe-e31d1bb951c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:53.374563 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b82b674a-00e1-46cc-abbe-e31d1bb951c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:53.374999 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b82b674a-00e1-46cc-abbe-e31d1bb951c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:53.583182 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b82b674a-00e1-46cc-abbe-e31d1bb951c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:53.591333 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b82b674a-00e1-46cc-abbe-e31d1bb951c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1661 microversion: 2.1 time: 0.231607 Apr 08 02:50:53.591890 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 234/483] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:53 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1661 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:54.609567 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-621b0d56-6631-4159-b0e2-180b21267a79 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:54.610257 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-621b0d56-6631-4159-b0e2-180b21267a79 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:50:54.618152 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-621b0d56-6631-4159-b0e2-180b21267a79 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:54.618597 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-621b0d56-6631-4159-b0e2-180b21267a79 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:54.619359 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-621b0d56-6631-4159-b0e2-180b21267a79 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:54.619783 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-621b0d56-6631-4159-b0e2-180b21267a79 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:54.818188 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-621b0d56-6631-4159-b0e2-180b21267a79 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:50:54.826627 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-621b0d56-6631-4159-b0e2-180b21267a79 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1665 microversion: 2.1 time: 0.220715 Apr 08 02:50:54.827197 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 250/484] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:54 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1665 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:00.818380 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-7d32badd-ade3-4e4b-a797-72fb036dfaa3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:00.819511 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-7d32badd-ade3-4e4b-a797-72fb036dfaa3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:00.826689 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7d32badd-ade3-4e4b-a797-72fb036dfaa3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:00.827134 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7d32badd-ade3-4e4b-a797-72fb036dfaa3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:00.827950 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7d32badd-ade3-4e4b-a797-72fb036dfaa3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:00.828386 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7d32badd-ade3-4e4b-a797-72fb036dfaa3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:00.892595 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-7d32badd-ade3-4e4b-a797-72fb036dfaa3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/os-volume_attachments/66339d64-fafc-4988-a496-b11d9878b1a4" status: 200 len: 194 microversion: 2.20 time: 0.078180 Apr 08 02:51:00.893151 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 235/485] 10.222.0.23 () {60 vars in 1453 bytes} [Fri Apr 8 02:51:00 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/os-volume_attachments/66339d64-fafc-4988-a496-b11d9878b1a4 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:51:00.987767 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3ef92ed6-505d-4f7e-8370-114a15ea778a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:00.988334 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-3ef92ed6-505d-4f7e-8370-114a15ea778a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:00.996076 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3ef92ed6-505d-4f7e-8370-114a15ea778a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:00.996519 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3ef92ed6-505d-4f7e-8370-114a15ea778a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:00.997272 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3ef92ed6-505d-4f7e-8370-114a15ea778a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:00.997701 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3ef92ed6-505d-4f7e-8370-114a15ea778a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:01.145717 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.objects.instance [None req-3ef92ed6-505d-4f7e-8370-114a15ea778a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lazy-loading 'services' on Instance uuid 89a1344c-2d91-4224-ab68-1898d4aa8b0f {{(pid=101272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:51:01.281181 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3ef92ed6-505d-4f7e-8370-114a15ea778a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "DELETE /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/os-volume_attachments/66339d64-fafc-4988-a496-b11d9878b1a4" status: 202 len: 0 microversion: 2.20 time: 0.296949 Apr 08 02:51:01.281796 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 251/486] 10.222.0.23 () {60 vars in 1456 bytes} [Fri Apr 8 02:51:00 2022] DELETE /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/os-volume_attachments/66339d64-fafc-4988-a496-b11d9878b1a4 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:51:01.290564 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-6d58cf07-445b-426f-8566-711e0e00ddef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:01.291492 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-6d58cf07-445b-426f-8566-711e0e00ddef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:01.298617 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6d58cf07-445b-426f-8566-711e0e00ddef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:01.299065 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6d58cf07-445b-426f-8566-711e0e00ddef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:01.299875 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6d58cf07-445b-426f-8566-711e0e00ddef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:01.302187 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6d58cf07-445b-426f-8566-711e0e00ddef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:01.367910 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-6d58cf07-445b-426f-8566-711e0e00ddef tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081712 Apr 08 02:51:01.368480 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 236/487] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Apr 8 02:51:01 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 02:51:02.379498 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b3ec8e11-feb3-4d55-9d37-d0d68e94668a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:02.380596 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b3ec8e11-feb3-4d55-9d37-d0d68e94668a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:02.388462 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b3ec8e11-feb3-4d55-9d37-d0d68e94668a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:02.388903 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b3ec8e11-feb3-4d55-9d37-d0d68e94668a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:02.389656 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b3ec8e11-feb3-4d55-9d37-d0d68e94668a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:02.390089 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b3ec8e11-feb3-4d55-9d37-d0d68e94668a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:02.455774 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b3ec8e11-feb3-4d55-9d37-d0d68e94668a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080470 Apr 08 02:51:02.456343 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 252/488] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Apr 8 02:51:02 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:51:03.467375 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e8c5a495-8005-4ce4-a9af-6d234de6012f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:03.468350 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e8c5a495-8005-4ce4-a9af-6d234de6012f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:03.476149 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e8c5a495-8005-4ce4-a9af-6d234de6012f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:03.476597 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e8c5a495-8005-4ce4-a9af-6d234de6012f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:03.477355 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e8c5a495-8005-4ce4-a9af-6d234de6012f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:03.477790 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e8c5a495-8005-4ce4-a9af-6d234de6012f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:03.542901 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e8c5a495-8005-4ce4-a9af-6d234de6012f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.079392 Apr 08 02:51:03.543458 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 237/489] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Apr 8 02:51:03 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:03.630036 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2dbd696f-d079-49d1-9309-34117a94e913 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:03.630522 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2dbd696f-d079-49d1-9309-34117a94e913 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:03.637765 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2dbd696f-d079-49d1-9309-34117a94e913 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:03.638222 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2dbd696f-d079-49d1-9309-34117a94e913 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:03.638989 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2dbd696f-d079-49d1-9309-34117a94e913 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:03.639428 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2dbd696f-d079-49d1-9309-34117a94e913 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:03.699946 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2dbd696f-d079-49d1-9309-34117a94e913 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Going to try to terminate instance {{(pid=101272) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:51:03.816300 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2dbd696f-d079-49d1-9309-34117a94e913 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "DELETE /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 204 len: 0 microversion: 2.20 time: 0.189111 Apr 08 02:51:03.817265 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 253/490] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Apr 8 02:51:03 2022] DELETE /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 08 02:51:03.826269 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5f875e67-8bb7-49b4-ae1f-6e4222bafc10 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:03.827041 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-5f875e67-8bb7-49b4-ae1f-6e4222bafc10 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:03.835393 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5f875e67-8bb7-49b4-ae1f-6e4222bafc10 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:03.835838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5f875e67-8bb7-49b4-ae1f-6e4222bafc10 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:03.836679 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5f875e67-8bb7-49b4-ae1f-6e4222bafc10 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:03.837115 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5f875e67-8bb7-49b4-ae1f-6e4222bafc10 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:04.029429 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5f875e67-8bb7-49b4-ae1f-6e4222bafc10 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:04.038198 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5f875e67-8bb7-49b4-ae1f-6e4222bafc10 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:04.039702 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5f875e67-8bb7-49b4-ae1f-6e4222bafc10 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:04.040860 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-5f875e67-8bb7-49b4-ae1f-6e4222bafc10 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1723 microversion: 2.20 time: 0.218876 Apr 08 02:51:04.041407 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 238/491] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:51:03 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:51:05.060084 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1d082ec8-7a66-400f-b8ee-91aa15cde323 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:05.060773 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1d082ec8-7a66-400f-b8ee-91aa15cde323 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:05.068326 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1d082ec8-7a66-400f-b8ee-91aa15cde323 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:05.068823 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1d082ec8-7a66-400f-b8ee-91aa15cde323 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:05.069832 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1d082ec8-7a66-400f-b8ee-91aa15cde323 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:05.071041 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1d082ec8-7a66-400f-b8ee-91aa15cde323 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:05.262889 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-6c7152f2-0563-4046-bf76-bf0f63a0cde0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:05.263409 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-6c7152f2-0563-4046-bf76-bf0f63a0cde0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:05.267969 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1d082ec8-7a66-400f-b8ee-91aa15cde323 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:05.271115 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6c7152f2-0563-4046-bf76-bf0f63a0cde0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:05.272241 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6c7152f2-0563-4046-bf76-bf0f63a0cde0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:05.273112 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6c7152f2-0563-4046-bf76-bf0f63a0cde0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:05.273549 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6c7152f2-0563-4046-bf76-bf0f63a0cde0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:05.279533 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1d082ec8-7a66-400f-b8ee-91aa15cde323 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:05.281436 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1d082ec8-7a66-400f-b8ee-91aa15cde323 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:05.282589 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1d082ec8-7a66-400f-b8ee-91aa15cde323 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1723 microversion: 2.20 time: 0.226740 Apr 08 02:51:05.283385 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 254/492] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:51:05 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:51:05.330586 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-6c7152f2-0563-4046-bf76-bf0f63a0cde0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a/ips" status: 200 len: 150 microversion: 2.1 time: 0.177490 Apr 08 02:51:05.331058 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 239/493] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Apr 8 02:51:05 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a/ips => generated 150 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:51:05.342102 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4e67b507-b19e-4e07-b41d-a8e8302ab237 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1736d6fd-791b-4949-a1c2-a2c0dabeefca"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:05.343151 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4e67b507-b19e-4e07-b41d-a8e8302ab237 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:05.350978 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4e67b507-b19e-4e07-b41d-a8e8302ab237 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:05.351414 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4e67b507-b19e-4e07-b41d-a8e8302ab237 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:05.352285 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4e67b507-b19e-4e07-b41d-a8e8302ab237 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:05.352771 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4e67b507-b19e-4e07-b41d-a8e8302ab237 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:05.497771 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-4e67b507-b19e-4e07-b41d-a8e8302ab237 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] HTTP exception thrown: Invalid volume: volume 1736d6fd-791b-4949-a1c2-a2c0dabeefca is already attached to instances: d7ae39c8-31a8-4fff-854c-06275d09d237 Apr 08 02:51:05.498372 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4e67b507-b19e-4e07-b41d-a8e8302ab237 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Returning 400 to user: Invalid volume: volume 1736d6fd-791b-4949-a1c2-a2c0dabeefca is already attached to instances: d7ae39c8-31a8-4fff-854c-06275d09d237 {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:51:05.499207 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-4e67b507-b19e-4e07-b41d-a8e8302ab237 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "POST /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.160959 Apr 08 02:51:05.499758 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 255/494] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Apr 8 02:51:05 2022] POST /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a/os-volume_attachments => generated 174 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 02:51:05.508424 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-7f706a21-44cd-4dbd-a6c1-bbe2d8aad122 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:05.508923 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-7f706a21-44cd-4dbd-a6c1-bbe2d8aad122 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:05.516143 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7f706a21-44cd-4dbd-a6c1-bbe2d8aad122 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:05.516594 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7f706a21-44cd-4dbd-a6c1-bbe2d8aad122 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:05.517364 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7f706a21-44cd-4dbd-a6c1-bbe2d8aad122 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:05.517822 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7f706a21-44cd-4dbd-a6c1-bbe2d8aad122 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:05.577839 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-7f706a21-44cd-4dbd-a6c1-bbe2d8aad122 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Going to try to terminate instance {{(pid=101271) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:51:05.834510 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-7f706a21-44cd-4dbd-a6c1-bbe2d8aad122 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 204 len: 0 microversion: 2.1 time: 0.329980 Apr 08 02:51:05.835521 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 240/495] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:51:05 2022] DELETE /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:51:05.843812 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5631cbc8-9a44-4d90-aef4-97127d5d75cb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:05.844567 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5631cbc8-9a44-4d90-aef4-97127d5d75cb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:05.854469 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5631cbc8-9a44-4d90-aef4-97127d5d75cb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:05.854913 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5631cbc8-9a44-4d90-aef4-97127d5d75cb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:05.855675 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5631cbc8-9a44-4d90-aef4-97127d5d75cb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:05.856128 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5631cbc8-9a44-4d90-aef4-97127d5d75cb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:06.048872 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5631cbc8-9a44-4d90-aef4-97127d5d75cb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:06.057459 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5631cbc8-9a44-4d90-aef4-97127d5d75cb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1680 microversion: 2.1 time: 0.217378 Apr 08 02:51:06.058232 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 256/496] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:05 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:06.301974 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-cb4b7dea-296e-41e1-9f97-35e6b184e88b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:06.302669 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-cb4b7dea-296e-41e1-9f97-35e6b184e88b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:06.310319 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cb4b7dea-296e-41e1-9f97-35e6b184e88b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:06.310764 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cb4b7dea-296e-41e1-9f97-35e6b184e88b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:06.311534 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cb4b7dea-296e-41e1-9f97-35e6b184e88b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:06.311998 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cb4b7dea-296e-41e1-9f97-35e6b184e88b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:06.617838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-cb4b7dea-296e-41e1-9f97-35e6b184e88b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:06.626432 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-cb4b7dea-296e-41e1-9f97-35e6b184e88b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:06.627956 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-cb4b7dea-296e-41e1-9f97-35e6b184e88b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:06.629081 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-cb4b7dea-296e-41e1-9f97-35e6b184e88b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1723 microversion: 2.20 time: 0.331186 Apr 08 02:51:06.629622 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 241/497] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:51:06 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:51:07.076485 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9b13b09a-60c1-473f-96a1-cb53b80c401e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:07.077132 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9b13b09a-60c1-473f-96a1-cb53b80c401e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:07.084665 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9b13b09a-60c1-473f-96a1-cb53b80c401e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:07.084952 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9b13b09a-60c1-473f-96a1-cb53b80c401e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:07.085719 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9b13b09a-60c1-473f-96a1-cb53b80c401e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:07.086156 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9b13b09a-60c1-473f-96a1-cb53b80c401e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:07.286203 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9b13b09a-60c1-473f-96a1-cb53b80c401e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:07.295808 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9b13b09a-60c1-473f-96a1-cb53b80c401e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1680 microversion: 2.1 time: 0.222892 Apr 08 02:51:07.296415 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 257/498] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:07 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1680 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:07.649410 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4b5b4d8b-3615-4400-bda2-22ad77da3627 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:07.650266 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-4b5b4d8b-3615-4400-bda2-22ad77da3627 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:07.657569 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4b5b4d8b-3615-4400-bda2-22ad77da3627 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:07.658258 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4b5b4d8b-3615-4400-bda2-22ad77da3627 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:07.658799 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4b5b4d8b-3615-4400-bda2-22ad77da3627 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:07.659226 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4b5b4d8b-3615-4400-bda2-22ad77da3627 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:07.801182 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4b5b4d8b-3615-4400-bda2-22ad77da3627 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:07.810336 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4b5b4d8b-3615-4400-bda2-22ad77da3627 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:07.811893 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4b5b4d8b-3615-4400-bda2-22ad77da3627 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:07.813050 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4b5b4d8b-3615-4400-bda2-22ad77da3627 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 200 len: 1656 microversion: 2.20 time: 0.168569 Apr 08 02:51:07.813595 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 242/499] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:51:07 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 1656 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:51:07.995080 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-815017f5-d24a-4b2d-b8da-0f09122b5d18 req-228d88b1-2998-4c76-9d37-ab34331c0db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a1344c-2d91-4224-ab68-1898d4aa8b0f", "name": "network-vif-deleted", "tag": "19d6323f-cbfa-4743-8474-008e1a45beee"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:07.996683 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:07.996683 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:51:08.004874 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-815017f5-d24a-4b2d-b8da-0f09122b5d18 req-228d88b1-2998-4c76-9d37-ab34331c0db8 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:08.005320 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-815017f5-d24a-4b2d-b8da-0f09122b5d18 req-228d88b1-2998-4c76-9d37-ab34331c0db8 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:08.024458 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-815017f5-d24a-4b2d-b8da-0f09122b5d18 req-228d88b1-2998-4c76-9d37-ab34331c0db8 service nova] Creating event network-vif-deleted:19d6323f-cbfa-4743-8474-008e1a45beee for instance 89a1344c-2d91-4224-ab68-1898d4aa8b0f on hv-cinder-83705 Apr 08 02:51:08.038565 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-815017f5-d24a-4b2d-b8da-0f09122b5d18 req-228d88b1-2998-4c76-9d37-ab34331c0db8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046141 Apr 08 02:51:08.039151 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 258/500] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:08.314569 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-7b84b58f-fc90-4a39-8651-19c51898bcb9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:08.315094 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-7b84b58f-fc90-4a39-8651-19c51898bcb9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:08.322684 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7b84b58f-fc90-4a39-8651-19c51898bcb9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:08.323134 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7b84b58f-fc90-4a39-8651-19c51898bcb9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:08.323907 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7b84b58f-fc90-4a39-8651-19c51898bcb9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:08.324368 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7b84b58f-fc90-4a39-8651-19c51898bcb9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:08.707284 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-7b84b58f-fc90-4a39-8651-19c51898bcb9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:08.719587 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-7b84b58f-fc90-4a39-8651-19c51898bcb9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1680 microversion: 2.1 time: 0.408813 Apr 08 02:51:08.720184 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 243/501] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:08 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1680 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:08.832957 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-78847522-7748-4921-8905-34d7b8bd0101 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:08.835167 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-78847522-7748-4921-8905-34d7b8bd0101 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:08.847667 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-78847522-7748-4921-8905-34d7b8bd0101 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:08.852571 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-78847522-7748-4921-8905-34d7b8bd0101 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:08.853398 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-78847522-7748-4921-8905-34d7b8bd0101 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:08.860378 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-78847522-7748-4921-8905-34d7b8bd0101 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:08.940920 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-78847522-7748-4921-8905-34d7b8bd0101 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] HTTP exception thrown: Instance 89a1344c-2d91-4224-ab68-1898d4aa8b0f could not be found. Apr 08 02:51:08.941970 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-78847522-7748-4921-8905-34d7b8bd0101 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Returning 404 to user: Instance 89a1344c-2d91-4224-ab68-1898d4aa8b0f could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:51:08.943047 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-78847522-7748-4921-8905-34d7b8bd0101 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 404 len: 111 microversion: 2.20 time: 0.114453 Apr 08 02:51:08.945008 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 259/502] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:51:08 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 02:51:08.952922 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d5ad85cd-6910-470f-8518-baae5fabc0c1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '.version_select at 0x7fbc3828f1f0>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:08.981160 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-d5ad85cd-6910-470f-8518-baae5fabc0c1 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-145837493" status: 204 len: 0 microversion: 2.20 time: 0.031653 Apr 08 02:51:08.982037 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 244/503] 10.222.0.23 () {60 vars in 1258 bytes} [Fri Apr 8 02:51:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-145837493 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 08 02:51:09.737009 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-15740eca-cb7a-4c0a-baac-2392449a97fc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:09.738005 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-15740eca-cb7a-4c0a-baac-2392449a97fc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:09.748692 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-15740eca-cb7a-4c0a-baac-2392449a97fc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:09.749722 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-15740eca-cb7a-4c0a-baac-2392449a97fc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:09.750713 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-15740eca-cb7a-4c0a-baac-2392449a97fc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:09.751346 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-15740eca-cb7a-4c0a-baac-2392449a97fc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:09.871524 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-15740eca-cb7a-4c0a-baac-2392449a97fc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:09.879751 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-15740eca-cb7a-4c0a-baac-2392449a97fc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1613 microversion: 2.1 time: 0.146712 Apr 08 02:51:09.880348 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 260/504] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:09 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1613 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:10.614999 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-71f57436-9b37-4d94-89dd-de1b1dc75365 req-aa2aa4a3-389c-415d-8685-3da4a6a35f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7f7249-30e7-40a1-9854-881972b2ed1a", "name": "network-vif-deleted", "tag": "666035a5-39af-4115-b103-73d896c88814"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:10.616859 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:10.616859 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:51:10.626354 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-71f57436-9b37-4d94-89dd-de1b1dc75365 req-aa2aa4a3-389c-415d-8685-3da4a6a35f60 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:10.626841 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-71f57436-9b37-4d94-89dd-de1b1dc75365 req-aa2aa4a3-389c-415d-8685-3da4a6a35f60 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:10.643450 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-71f57436-9b37-4d94-89dd-de1b1dc75365 req-aa2aa4a3-389c-415d-8685-3da4a6a35f60 service nova] Creating event network-vif-deleted:666035a5-39af-4115-b103-73d896c88814 for instance df7f7249-30e7-40a1-9854-881972b2ed1a on hv-cinder-83705 Apr 08 02:51:10.648900 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-71f57436-9b37-4d94-89dd-de1b1dc75365 req-aa2aa4a3-389c-415d-8685-3da4a6a35f60 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037519 Apr 08 02:51:10.649505 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 245/505] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:51:10.799371 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5dcd67ee-24e3-4e47-8517-9341cc6a6371 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-926834550", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-444463297", "security_groups": [{"name": "tempest-secgroup-smoke-1315786892"}], "networks": [{"uuid": "71466063-e434-4e94-a6a1-5afeb4638af7"}], "block_device_mapping_v2": [{"uuid": "e5db8a9b-450a-495d-acca-1638c38bcc54", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:10.897809 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e62b45a1-2ef7-47eb-9860-4953cc7a1f80 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:10.898723 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e62b45a1-2ef7-47eb-9860-4953cc7a1f80 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:10.907226 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e62b45a1-2ef7-47eb-9860-4953cc7a1f80 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:10.907851 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e62b45a1-2ef7-47eb-9860-4953cc7a1f80 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:10.908984 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e62b45a1-2ef7-47eb-9860-4953cc7a1f80 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:10.909635 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e62b45a1-2ef7-47eb-9860-4953cc7a1f80 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:10.982482 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.network.neutron [None req-5dcd67ee-24e3-4e47-8517-9341cc6a6371 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] validate_networks() for [('71466063-e434-4e94-a6a1-5afeb4638af7', None, None, None)] {{(pid=101272) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:51:10.983271 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e62b45a1-2ef7-47eb-9860-4953cc7a1f80 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:10.984091 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e62b45a1-2ef7-47eb-9860-4953cc7a1f80 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:10.984734 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.objects.instance [None req-e62b45a1-2ef7-47eb-9860-4953cc7a1f80 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lazy-loading 'fault' on Instance uuid df7f7249-30e7-40a1-9854-881972b2ed1a {{(pid=101271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:51:11.159599 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e62b45a1-2ef7-47eb-9860-4953cc7a1f80 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:11.170459 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e62b45a1-2ef7-47eb-9860-4953cc7a1f80 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 200 len: 1330 microversion: 2.1 time: 0.276840 Apr 08 02:51:11.171557 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 246/506] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:10 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 1330 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:11.473970 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-407e12c9-152c-498a-9875-a1f4af9604e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Action: 'create', calling method: .version_select at 0x7fbc381c0f70>, body: {"keypair": {"name": "tempest-keypair-1712436184"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:11.499047 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-407e12c9-152c-498a-9875-a1f4af9604e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Getting quotas for project 688b5f689e3e41249484667a939fd5f8. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:51:11.510195 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-407e12c9-152c-498a-9875-a1f4af9604e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Getting quotas for user e8e3c70e491a4f0691f753c8e2b95e95 and project 688b5f689e3e41249484667a939fd5f8. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:51:11.649409 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-5dcd67ee-24e3-4e47-8517-9341cc6a6371 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Flavor limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:51:11.649978 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-5dcd67ee-24e3-4e47-8517-9341cc6a6371 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Image limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:51:11.650824 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-5dcd67ee-24e3-4e47-8517-9341cc6a6371 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Flavor pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:51:11.651432 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-5dcd67ee-24e3-4e47-8517-9341cc6a6371 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Image pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:51:11.652096 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-5dcd67ee-24e3-4e47-8517-9341cc6a6371 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:51:11.660593 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5dcd67ee-24e3-4e47-8517-9341cc6a6371 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:11.661424 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5dcd67ee-24e3-4e47-8517-9341cc6a6371 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:11.662475 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5dcd67ee-24e3-4e47-8517-9341cc6a6371 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:11.662982 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5dcd67ee-24e3-4e47-8517-9341cc6a6371 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:11.680534 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-5dcd67ee-24e3-4e47-8517-9341cc6a6371 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Getting quotas for project 0f7f360a7ebf4464b91dce9442330898. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:51:11.684546 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-5dcd67ee-24e3-4e47-8517-9341cc6a6371 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Getting quotas for user a0f675843ecb4ef2b4c1b450b6bacf88 and project 0f7f360a7ebf4464b91dce9442330898. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:51:11.779446 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5dcd67ee-24e3-4e47-8517-9341cc6a6371 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Going to run 1 instances... {{(pid=101272) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:51:11.781474 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5dcd67ee-24e3-4e47-8517-9341cc6a6371 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e5db8a9b-450a-495d-acca-1638c38bcc54',volume_size=None,volume_type=None)] {{(pid=101272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:51:11.783386 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-407e12c9-152c-498a-9875-a1f4af9604e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Getting quotas for project 688b5f689e3e41249484667a939fd5f8. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:51:11.787999 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-407e12c9-152c-498a-9875-a1f4af9604e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Getting quotas for user e8e3c70e491a4f0691f753c8e2b95e95 and project 688b5f689e3e41249484667a939fd5f8. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:51:11.800942 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-407e12c9-152c-498a-9875-a1f4af9604e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.330596 Apr 08 02:51:11.801522 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 247/507] 10.222.0.23 () {62 vars in 1198 bytes} [Fri Apr 8 02:51:11 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 332 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 08 02:51:11.968538 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5dcd67ee-24e3-4e47-8517-9341cc6a6371 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.172787 Apr 08 02:51:11.969768 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 261/508] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:51:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:51:11.986804 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c81c8134-1294-4907-b51e-e89f5165fe5d tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:11.988376 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c81c8134-1294-4907-b51e-e89f5165fe5d tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:12.083277 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c81c8134-1294-4907-b51e-e89f5165fe5d tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:12.092870 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c81c8134-1294-4907-b51e-e89f5165fe5d tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1087 microversion: 2.1 time: 0.113975 Apr 08 02:51:12.100877 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 248/509] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:11 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1087 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:12.190137 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-36e89b71-a784-43b5-bf6e-0478c062f665 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:12.191429 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-36e89b71-a784-43b5-bf6e-0478c062f665 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:12.200884 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-36e89b71-a784-43b5-bf6e-0478c062f665 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:12.201626 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-36e89b71-a784-43b5-bf6e-0478c062f665 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:12.202604 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-36e89b71-a784-43b5-bf6e-0478c062f665 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:12.203489 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-36e89b71-a784-43b5-bf6e-0478c062f665 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:12.275094 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-36e89b71-a784-43b5-bf6e-0478c062f665 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] HTTP exception thrown: Instance df7f7249-30e7-40a1-9854-881972b2ed1a could not be found. Apr 08 02:51:12.275691 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-36e89b71-a784-43b5-bf6e-0478c062f665 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Returning 404 to user: Instance df7f7249-30e7-40a1-9854-881972b2ed1a could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:51:12.276556 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-36e89b71-a784-43b5-bf6e-0478c062f665 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 404 len: 111 microversion: 2.1 time: 0.091452 Apr 08 02:51:12.277094 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 262/510] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:12 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:51:12.286591 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f194b5f9-a759-49fb-95c9-30cf16967743 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '.version_select at 0x7fbc381c0ee0>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:12.313836 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f194b5f9-a759-49fb-95c9-30cf16967743 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247122313" status: 202 len: 0 microversion: 2.1 time: 0.030671 Apr 08 02:51:12.319067 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 249/511] 10.222.0.23 () {58 vars in 1220 bytes} [Fri Apr 8 02:51:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247122313 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:51:13.110569 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-434e01f4-9599-4aac-8b01-ee366c6ee50c tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:13.111190 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-434e01f4-9599-4aac-8b01-ee366c6ee50c tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:13.119625 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-434e01f4-9599-4aac-8b01-ee366c6ee50c tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:13.120341 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-434e01f4-9599-4aac-8b01-ee366c6ee50c tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:13.121136 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-434e01f4-9599-4aac-8b01-ee366c6ee50c tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:13.121578 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-434e01f4-9599-4aac-8b01-ee366c6ee50c tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:13.378516 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-434e01f4-9599-4aac-8b01-ee366c6ee50c tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:13.402534 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-434e01f4-9599-4aac-8b01-ee366c6ee50c tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1185 microversion: 2.1 time: 0.295519 Apr 08 02:51:13.403173 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 263/512] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:13 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1185 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:13.599955 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a0b699fb-f819-4aea-9565-47659621bce8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:13.600542 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a0b699fb-f819-4aea-9565-47659621bce8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:13.608143 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a0b699fb-f819-4aea-9565-47659621bce8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:13.608591 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a0b699fb-f819-4aea-9565-47659621bce8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:13.609555 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a0b699fb-f819-4aea-9565-47659621bce8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:13.609990 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a0b699fb-f819-4aea-9565-47659621bce8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:13.758349 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.objects.instance [None req-a0b699fb-f819-4aea-9565-47659621bce8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lazy-loading 'services' on Instance uuid d7ae39c8-31a8-4fff-854c-06275d09d237 {{(pid=101271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:51:13.902209 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a0b699fb-f819-4aea-9565-47659621bce8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237/os-volume_attachments/1736d6fd-791b-4949-a1c2-a2c0dabeefca" status: 202 len: 0 microversion: 2.1 time: 0.305937 Apr 08 02:51:13.902882 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 250/513] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Apr 8 02:51:13 2022] DELETE /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237/os-volume_attachments/1736d6fd-791b-4949-a1c2-a2c0dabeefca => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:51:13.911156 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-081b81a9-6be3-42d2-a1c2-bbd62def58f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:13.913363 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-081b81a9-6be3-42d2-a1c2-bbd62def58f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:13.928633 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-081b81a9-6be3-42d2-a1c2-bbd62def58f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:13.929602 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-081b81a9-6be3-42d2-a1c2-bbd62def58f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:13.930518 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-081b81a9-6be3-42d2-a1c2-bbd62def58f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:13.930949 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-081b81a9-6be3-42d2-a1c2-bbd62def58f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:14.008710 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-081b81a9-6be3-42d2-a1c2-bbd62def58f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101311 Apr 08 02:51:14.009506 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 264/514] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:51:13 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:14.164120 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f63f86ca-7bdc-4df7-896f-a3da347be0fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1414320572", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f572796-aa3b-4385-be7e-dfaa12bb77ed"}], "security_groups": [{"name": "tempest-securitygroup--566022511"}], "key_name": "tempest-keypair-1712436184", "user_data": "}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:14.402366 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.network.neutron [None req-f63f86ca-7bdc-4df7-896f-a3da347be0fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] validate_networks() for [('7f572796-aa3b-4385-be7e-dfaa12bb77ed', None, None, None)] {{(pid=101271) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:51:14.419274 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-7240c529-d7b3-4a43-ac6a-016d6fff3348 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:14.419950 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-7240c529-d7b3-4a43-ac6a-016d6fff3348 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:14.428117 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7240c529-d7b3-4a43-ac6a-016d6fff3348 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:14.429261 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7240c529-d7b3-4a43-ac6a-016d6fff3348 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:14.430173 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7240c529-d7b3-4a43-ac6a-016d6fff3348 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:14.430794 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7240c529-d7b3-4a43-ac6a-016d6fff3348 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:14.634689 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-7240c529-d7b3-4a43-ac6a-016d6fff3348 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:14.643032 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-7240c529-d7b3-4a43-ac6a-016d6fff3348 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1271 microversion: 2.1 time: 0.227350 Apr 08 02:51:14.643659 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 265/515] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:14 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1271 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:15.020351 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-78746c8b-dd2a-4802-bfe1-245f00383325 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:15.022149 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-78746c8b-dd2a-4802-bfe1-245f00383325 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:15.030132 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-78746c8b-dd2a-4802-bfe1-245f00383325 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:15.030983 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-78746c8b-dd2a-4802-bfe1-245f00383325 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:15.032028 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-78746c8b-dd2a-4802-bfe1-245f00383325 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:15.032661 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-78746c8b-dd2a-4802-bfe1-245f00383325 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:15.105858 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-78746c8b-dd2a-4802-bfe1-245f00383325 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089167 Apr 08 02:51:15.106511 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 266/516] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:51:15 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:51:15.586590 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-f63f86ca-7bdc-4df7-896f-a3da347be0fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Flavor limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:51:15.587082 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-f63f86ca-7bdc-4df7-896f-a3da347be0fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Image limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:51:15.587466 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-f63f86ca-7bdc-4df7-896f-a3da347be0fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Flavor pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:51:15.587869 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-f63f86ca-7bdc-4df7-896f-a3da347be0fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Image pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:51:15.588307 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-f63f86ca-7bdc-4df7-896f-a3da347be0fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:51:15.596648 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f63f86ca-7bdc-4df7-896f-a3da347be0fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:15.597088 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f63f86ca-7bdc-4df7-896f-a3da347be0fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:15.597996 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f63f86ca-7bdc-4df7-896f-a3da347be0fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:15.598435 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f63f86ca-7bdc-4df7-896f-a3da347be0fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:15.617718 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-f63f86ca-7bdc-4df7-896f-a3da347be0fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Getting quotas for project 688b5f689e3e41249484667a939fd5f8. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:51:15.621709 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-f63f86ca-7bdc-4df7-896f-a3da347be0fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Getting quotas for user e8e3c70e491a4f0691f753c8e2b95e95 and project 688b5f689e3e41249484667a939fd5f8. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:51:15.632663 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f63f86ca-7bdc-4df7-896f-a3da347be0fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Going to run 1 instances... {{(pid=101271) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:51:15.635388 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f63f86ca-7bdc-4df7-896f-a3da347be0fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:51:15.660864 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-28a8246a-bb68-428b-ba86-7523f6d5b3eb tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:15.661480 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-28a8246a-bb68-428b-ba86-7523f6d5b3eb tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:15.670969 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-28a8246a-bb68-428b-ba86-7523f6d5b3eb tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:15.671665 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-28a8246a-bb68-428b-ba86-7523f6d5b3eb tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:15.672622 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-28a8246a-bb68-428b-ba86-7523f6d5b3eb tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:15.673465 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-28a8246a-bb68-428b-ba86-7523f6d5b3eb tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:15.684424 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f63f86ca-7bdc-4df7-896f-a3da347be0fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.525708 Apr 08 02:51:15.685067 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 251/517] 10.222.0.23 () {62 vars in 1187 bytes} [Fri Apr 8 02:51:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 1527 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 08 02:51:15.695470 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-68cae790-aaa0-49b2-b29d-f638cd8301da tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:15.696157 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-68cae790-aaa0-49b2-b29d-f638cd8301da tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:15.837839 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-68cae790-aaa0-49b2-b29d-f638cd8301da tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:15.849104 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-68cae790-aaa0-49b2-b29d-f638cd8301da tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:15.851965 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-68cae790-aaa0-49b2-b29d-f638cd8301da tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:15.853249 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-68cae790-aaa0-49b2-b29d-f638cd8301da tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1282 microversion: 2.20 time: 0.161703 Apr 08 02:51:15.854221 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 252/518] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:51:15 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1282 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:51:15.930015 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-28a8246a-bb68-428b-ba86-7523f6d5b3eb tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:15.941674 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-28a8246a-bb68-428b-ba86-7523f6d5b3eb tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1259 microversion: 2.1 time: 0.284498 Apr 08 02:51:15.942785 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 267/519] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:15 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1259 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:16.117979 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ee8da42c-43c7-4aeb-ac0a-c3ab421895bf tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:16.118993 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ee8da42c-43c7-4aeb-ac0a-c3ab421895bf tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:16.126607 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ee8da42c-43c7-4aeb-ac0a-c3ab421895bf tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:16.126948 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ee8da42c-43c7-4aeb-ac0a-c3ab421895bf tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:16.127711 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ee8da42c-43c7-4aeb-ac0a-c3ab421895bf tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:16.128173 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ee8da42c-43c7-4aeb-ac0a-c3ab421895bf tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:16.194326 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ee8da42c-43c7-4aeb-ac0a-c3ab421895bf tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080656 Apr 08 02:51:16.199718 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 253/520] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:51:16 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:51:16.202417 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-73c62093-659a-42a3-8d26-6b3565960094 req-cc4dfece-40d0-4f0d-bd94-fe4d55bd56d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c826480b-a813-4281-83a6-c743d8a84b9c", "tag": "105b6cec-7cb5-414f-809c-11a2bc5ec384"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:16.204042 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:16.204042 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:51:16.223939 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-73c62093-659a-42a3-8d26-6b3565960094 req-cc4dfece-40d0-4f0d-bd94-fe4d55bd56d9 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:16.225033 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-73c62093-659a-42a3-8d26-6b3565960094 req-cc4dfece-40d0-4f0d-bd94-fe4d55bd56d9 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:16.250477 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-73c62093-659a-42a3-8d26-6b3565960094 req-cc4dfece-40d0-4f0d-bd94-fe4d55bd56d9 service nova] Creating event network-changed:105b6cec-7cb5-414f-809c-11a2bc5ec384 for instance c826480b-a813-4281-83a6-c743d8a84b9c on hv-cinder-83705 Apr 08 02:51:16.255646 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-73c62093-659a-42a3-8d26-6b3565960094 req-cc4dfece-40d0-4f0d-bd94-fe4d55bd56d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059340 Apr 08 02:51:16.256996 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 268/521] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:51:16.313189 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-86b676ce-3459-44b7-afa5-7358f959ae8d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:16.313840 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-86b676ce-3459-44b7-afa5-7358f959ae8d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:16.324401 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-86b676ce-3459-44b7-afa5-7358f959ae8d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:16.324855 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-86b676ce-3459-44b7-afa5-7358f959ae8d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:16.325638 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-86b676ce-3459-44b7-afa5-7358f959ae8d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:16.326084 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-86b676ce-3459-44b7-afa5-7358f959ae8d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:16.398862 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-86b676ce-3459-44b7-afa5-7358f959ae8d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Going to try to terminate instance {{(pid=101271) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:51:16.527194 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-86b676ce-3459-44b7-afa5-7358f959ae8d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 204 len: 0 microversion: 2.1 time: 0.217546 Apr 08 02:51:16.528718 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 254/522] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:51:16 2022] DELETE /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:51:16.539431 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9e257be2-248b-40a9-90f0-8390f6c10a63 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:16.540157 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9e257be2-248b-40a9-90f0-8390f6c10a63 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:16.547833 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9e257be2-248b-40a9-90f0-8390f6c10a63 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:16.548339 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9e257be2-248b-40a9-90f0-8390f6c10a63 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:16.549187 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9e257be2-248b-40a9-90f0-8390f6c10a63 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:16.549659 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9e257be2-248b-40a9-90f0-8390f6c10a63 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:16.775180 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9e257be2-248b-40a9-90f0-8390f6c10a63 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:16.783805 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9e257be2-248b-40a9-90f0-8390f6c10a63 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1680 microversion: 2.1 time: 0.250599 Apr 08 02:51:16.784475 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 269/523] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:16 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1680 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:16.871436 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-7baa45f3-90b8-4835-abb7-641667c4ef56 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:16.872800 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-7baa45f3-90b8-4835-abb7-641667c4ef56 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:16.880039 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7baa45f3-90b8-4835-abb7-641667c4ef56 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:16.880490 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7baa45f3-90b8-4835-abb7-641667c4ef56 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:16.881798 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7baa45f3-90b8-4835-abb7-641667c4ef56 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:16.882347 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7baa45f3-90b8-4835-abb7-641667c4ef56 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:16.960576 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-7c690c07-0849-49bf-bb26-f3fc7493ebff tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:16.961097 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-7c690c07-0849-49bf-bb26-f3fc7493ebff tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:16.968843 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7c690c07-0849-49bf-bb26-f3fc7493ebff tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:16.969374 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7c690c07-0849-49bf-bb26-f3fc7493ebff tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:16.970110 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7c690c07-0849-49bf-bb26-f3fc7493ebff tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:16.970558 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7c690c07-0849-49bf-bb26-f3fc7493ebff tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:17.063049 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-7baa45f3-90b8-4835-abb7-641667c4ef56 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:17.073647 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-7baa45f3-90b8-4835-abb7-641667c4ef56 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:17.075211 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-7baa45f3-90b8-4835-abb7-641667c4ef56 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:17.076364 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-7baa45f3-90b8-4835-abb7-641667c4ef56 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1334 microversion: 2.20 time: 0.209161 Apr 08 02:51:17.076904 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 255/524] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:51:16 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1334 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:51:17.286578 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-7c690c07-0849-49bf-bb26-f3fc7493ebff tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:17.295112 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-7c690c07-0849-49bf-bb26-f3fc7493ebff tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1259 microversion: 2.1 time: 0.338801 Apr 08 02:51:17.305272 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 270/525] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:16 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1259 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:17.801474 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a3abdc62-c708-455c-822b-dfbfa9a0d78f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:17.802084 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a3abdc62-c708-455c-822b-dfbfa9a0d78f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:17.810144 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a3abdc62-c708-455c-822b-dfbfa9a0d78f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:17.810588 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a3abdc62-c708-455c-822b-dfbfa9a0d78f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:17.811351 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a3abdc62-c708-455c-822b-dfbfa9a0d78f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:17.811779 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a3abdc62-c708-455c-822b-dfbfa9a0d78f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:18.094641 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2bc8ae68-6355-4f84-92e3-0ae5924e43b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:18.095253 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2bc8ae68-6355-4f84-92e3-0ae5924e43b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:18.103458 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2bc8ae68-6355-4f84-92e3-0ae5924e43b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:18.104187 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2bc8ae68-6355-4f84-92e3-0ae5924e43b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:18.105156 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2bc8ae68-6355-4f84-92e3-0ae5924e43b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:18.105754 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2bc8ae68-6355-4f84-92e3-0ae5924e43b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:18.282014 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a3abdc62-c708-455c-822b-dfbfa9a0d78f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:18.293049 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a3abdc62-c708-455c-822b-dfbfa9a0d78f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1680 microversion: 2.1 time: 0.495067 Apr 08 02:51:18.294222 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 256/526] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:17 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1680 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:18.320064 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2cdd99e0-0326-4c58-b345-f7423699f7ff tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:18.322925 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2cdd99e0-0326-4c58-b345-f7423699f7ff tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:18.334135 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2cdd99e0-0326-4c58-b345-f7423699f7ff tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:18.334837 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2cdd99e0-0326-4c58-b345-f7423699f7ff tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:18.335848 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2cdd99e0-0326-4c58-b345-f7423699f7ff tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:18.336399 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2cdd99e0-0326-4c58-b345-f7423699f7ff tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:18.681264 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2bc8ae68-6355-4f84-92e3-0ae5924e43b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:18.691081 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2bc8ae68-6355-4f84-92e3-0ae5924e43b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:18.692730 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2bc8ae68-6355-4f84-92e3-0ae5924e43b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:18.694366 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2bc8ae68-6355-4f84-92e3-0ae5924e43b3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1407 microversion: 2.20 time: 0.603431 Apr 08 02:51:18.695393 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 271/527] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:51:18 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1407 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:51:18.970142 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2cdd99e0-0326-4c58-b345-f7423699f7ff tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:18.983988 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2cdd99e0-0326-4c58-b345-f7423699f7ff tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1259 microversion: 2.1 time: 0.674776 Apr 08 02:51:18.984889 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 257/528] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:18 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1259 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:19.258977 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-4408af9c-c85f-44f1-9116-e3099352b545 req-2e7881b2-9be0-47a7-8527-e9352ad958a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66", "tag": "b1b47b52-100c-4e18-8a4a-3d16d8561d14"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:19.260667 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:19.260667 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:51:19.278311 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-4408af9c-c85f-44f1-9116-e3099352b545 req-2e7881b2-9be0-47a7-8527-e9352ad958a2 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:19.279515 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-4408af9c-c85f-44f1-9116-e3099352b545 req-2e7881b2-9be0-47a7-8527-e9352ad958a2 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:19.299056 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-4408af9c-c85f-44f1-9116-e3099352b545 req-2e7881b2-9be0-47a7-8527-e9352ad958a2 service nova] Creating event network-changed:b1b47b52-100c-4e18-8a4a-3d16d8561d14 for instance 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 on hv-cinder-83705 Apr 08 02:51:19.310631 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a61d609e-9264-4673-8923-0b591bdbfe76 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:19.311908 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a61d609e-9264-4673-8923-0b591bdbfe76 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:19.321068 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-4408af9c-c85f-44f1-9116-e3099352b545 req-2e7881b2-9be0-47a7-8527-e9352ad958a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050750 Apr 08 02:51:19.322991 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 272/529] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:51:19.326078 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a61d609e-9264-4673-8923-0b591bdbfe76 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:19.326702 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a61d609e-9264-4673-8923-0b591bdbfe76 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:19.327635 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a61d609e-9264-4673-8923-0b591bdbfe76 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:19.328271 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a61d609e-9264-4673-8923-0b591bdbfe76 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:19.486100 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a61d609e-9264-4673-8923-0b591bdbfe76 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:19.495692 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a61d609e-9264-4673-8923-0b591bdbfe76 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1613 microversion: 2.1 time: 0.188614 Apr 08 02:51:19.496781 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 258/530] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:19 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1613 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:19.717933 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e2b90f2d-573e-4cab-81a0-72964147b09b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:19.719965 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e2b90f2d-573e-4cab-81a0-72964147b09b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:19.730263 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e2b90f2d-573e-4cab-81a0-72964147b09b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:19.731045 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e2b90f2d-573e-4cab-81a0-72964147b09b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:19.732079 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e2b90f2d-573e-4cab-81a0-72964147b09b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:19.732724 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e2b90f2d-573e-4cab-81a0-72964147b09b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:19.786303 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-a3da7142-1418-4465-9311-8c68f317fdc4 req-1be9e3f5-5145-454a-93cb-30f6d0e1ed33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7ae39c8-31a8-4fff-854c-06275d09d237", "name": "network-vif-deleted", "tag": "823fa2cc-3d06-401c-8c4e-211154f6e79b"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:19.789393 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:19.789393 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:51:19.799312 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-a3da7142-1418-4465-9311-8c68f317fdc4 req-1be9e3f5-5145-454a-93cb-30f6d0e1ed33 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:19.800206 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-a3da7142-1418-4465-9311-8c68f317fdc4 req-1be9e3f5-5145-454a-93cb-30f6d0e1ed33 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:19.823059 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-a3da7142-1418-4465-9311-8c68f317fdc4 req-1be9e3f5-5145-454a-93cb-30f6d0e1ed33 service nova] Creating event network-vif-deleted:823fa2cc-3d06-401c-8c4e-211154f6e79b for instance d7ae39c8-31a8-4fff-854c-06275d09d237 on hv-cinder-83705 Apr 08 02:51:19.833766 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-a3da7142-1418-4465-9311-8c68f317fdc4 req-1be9e3f5-5145-454a-93cb-30f6d0e1ed33 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051211 Apr 08 02:51:19.835132 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 259/531] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:51:20.001905 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ba4f7935-c17d-48b0-ab18-fe536ec1167c tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:20.002970 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ba4f7935-c17d-48b0-ab18-fe536ec1167c tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:20.011459 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ba4f7935-c17d-48b0-ab18-fe536ec1167c tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:20.011983 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ba4f7935-c17d-48b0-ab18-fe536ec1167c tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:20.013062 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ba4f7935-c17d-48b0-ab18-fe536ec1167c tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:20.013604 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ba4f7935-c17d-48b0-ab18-fe536ec1167c tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:20.079082 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e2b90f2d-573e-4cab-81a0-72964147b09b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:20.087751 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e2b90f2d-573e-4cab-81a0-72964147b09b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:20.089279 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e2b90f2d-573e-4cab-81a0-72964147b09b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:20.090357 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e2b90f2d-573e-4cab-81a0-72964147b09b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1407 microversion: 2.20 time: 0.380562 Apr 08 02:51:20.090918 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 273/532] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:51:19 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1407 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:51:20.226209 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ba4f7935-c17d-48b0-ab18-fe536ec1167c tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:20.234922 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ba4f7935-c17d-48b0-ab18-fe536ec1167c tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1259 microversion: 2.1 time: 0.237186 Apr 08 02:51:20.235500 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 260/533] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:19 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:20.514606 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f58ed83f-a2d1-43a8-82eb-9a1fdfe3b1d8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:20.516498 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f58ed83f-a2d1-43a8-82eb-9a1fdfe3b1d8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:20.526691 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f58ed83f-a2d1-43a8-82eb-9a1fdfe3b1d8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:20.527328 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f58ed83f-a2d1-43a8-82eb-9a1fdfe3b1d8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:20.528326 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f58ed83f-a2d1-43a8-82eb-9a1fdfe3b1d8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:20.528707 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f58ed83f-a2d1-43a8-82eb-9a1fdfe3b1d8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:20.611073 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f58ed83f-a2d1-43a8-82eb-9a1fdfe3b1d8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:20.611720 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f58ed83f-a2d1-43a8-82eb-9a1fdfe3b1d8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:20.612201 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.objects.instance [None req-f58ed83f-a2d1-43a8-82eb-9a1fdfe3b1d8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lazy-loading 'fault' on Instance uuid d7ae39c8-31a8-4fff-854c-06275d09d237 {{(pid=101272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:51:20.713931 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f58ed83f-a2d1-43a8-82eb-9a1fdfe3b1d8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:20.721475 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f58ed83f-a2d1-43a8-82eb-9a1fdfe3b1d8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 200 len: 1332 microversion: 2.1 time: 0.211083 Apr 08 02:51:20.731606 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 274/534] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:20 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 1332 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:21.108913 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-23e8d72c-a90b-4603-943f-508994c69e36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:21.109529 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-23e8d72c-a90b-4603-943f-508994c69e36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:21.117361 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23e8d72c-a90b-4603-943f-508994c69e36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:21.117808 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23e8d72c-a90b-4603-943f-508994c69e36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:21.118592 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23e8d72c-a90b-4603-943f-508994c69e36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:21.119013 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23e8d72c-a90b-4603-943f-508994c69e36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:21.251767 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0c51767b-a8a0-41bb-a3bc-19f749492bd5 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:21.252333 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0c51767b-a8a0-41bb-a3bc-19f749492bd5 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:21.260581 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0c51767b-a8a0-41bb-a3bc-19f749492bd5 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:21.261027 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0c51767b-a8a0-41bb-a3bc-19f749492bd5 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:21.261811 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0c51767b-a8a0-41bb-a3bc-19f749492bd5 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:21.262253 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0c51767b-a8a0-41bb-a3bc-19f749492bd5 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:21.318619 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-23e8d72c-a90b-4603-943f-508994c69e36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:21.329779 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-23e8d72c-a90b-4603-943f-508994c69e36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:21.332191 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-23e8d72c-a90b-4603-943f-508994c69e36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:21.333459 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-23e8d72c-a90b-4603-943f-508994c69e36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1407 microversion: 2.20 time: 0.228386 Apr 08 02:51:21.334177 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 261/535] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:51:21 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:51:21.471795 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0c51767b-a8a0-41bb-a3bc-19f749492bd5 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:21.480192 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0c51767b-a8a0-41bb-a3bc-19f749492bd5 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1259 microversion: 2.1 time: 0.232239 Apr 08 02:51:21.480760 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 275/536] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:21 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:21.738923 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2afb62aa-9416-4356-af40-4f54916c5281 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:21.739526 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2afb62aa-9416-4356-af40-4f54916c5281 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:21.747733 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2afb62aa-9416-4356-af40-4f54916c5281 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:21.748203 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2afb62aa-9416-4356-af40-4f54916c5281 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:21.748959 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2afb62aa-9416-4356-af40-4f54916c5281 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:21.749385 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2afb62aa-9416-4356-af40-4f54916c5281 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:21.798943 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-2afb62aa-9416-4356-af40-4f54916c5281 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] HTTP exception thrown: Instance d7ae39c8-31a8-4fff-854c-06275d09d237 could not be found. Apr 08 02:51:21.799465 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2afb62aa-9416-4356-af40-4f54916c5281 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Returning 404 to user: Instance d7ae39c8-31a8-4fff-854c-06275d09d237 could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:51:21.800281 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2afb62aa-9416-4356-af40-4f54916c5281 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 404 len: 111 microversion: 2.1 time: 0.065081 Apr 08 02:51:21.800789 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 262/537] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:21 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:51:21.809544 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-a2fccdb3-9436-4a7a-b93e-bcc5dc0dab33 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '.version_select at 0x7fbc38098280>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:21.827010 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-a2fccdb3-9436-4a7a-b93e-bcc5dc0dab33 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2051723958" status: 202 len: 0 microversion: 2.1 time: 0.021059 Apr 08 02:51:21.827562 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 276/538] 10.222.0.23 () {58 vars in 1220 bytes} [Fri Apr 8 02:51:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2051723958 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:51:22.352375 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-00db804f-cbf2-4a3f-9635-2a715de6dc9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:22.353040 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-00db804f-cbf2-4a3f-9635-2a715de6dc9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:22.360193 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-00db804f-cbf2-4a3f-9635-2a715de6dc9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:22.360637 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-00db804f-cbf2-4a3f-9635-2a715de6dc9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:22.361396 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-00db804f-cbf2-4a3f-9635-2a715de6dc9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:22.361831 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-00db804f-cbf2-4a3f-9635-2a715de6dc9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:22.498448 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-add4b70f-8b4a-4df4-bd67-6b5937d21b74 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:22.499288 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-add4b70f-8b4a-4df4-bd67-6b5937d21b74 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:22.509842 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-add4b70f-8b4a-4df4-bd67-6b5937d21b74 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:22.510600 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-add4b70f-8b4a-4df4-bd67-6b5937d21b74 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:22.512274 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-add4b70f-8b4a-4df4-bd67-6b5937d21b74 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:22.512822 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-add4b70f-8b4a-4df4-bd67-6b5937d21b74 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:22.569145 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-00db804f-cbf2-4a3f-9635-2a715de6dc9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:22.579667 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-00db804f-cbf2-4a3f-9635-2a715de6dc9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:22.581204 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-00db804f-cbf2-4a3f-9635-2a715de6dc9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:22.582309 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-00db804f-cbf2-4a3f-9635-2a715de6dc9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1407 microversion: 2.20 time: 0.234513 Apr 08 02:51:22.587767 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 263/539] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:51:22 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:51:22.962203 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-add4b70f-8b4a-4df4-bd67-6b5937d21b74 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:22.970556 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-add4b70f-8b4a-4df4-bd67-6b5937d21b74 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1259 microversion: 2.1 time: 0.477162 Apr 08 02:51:22.971115 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 277/540] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:22 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1259 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:22.984261 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f4498ee5-ea78-4774-b8b4-66e9e66e25d7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Action: 'create', calling method: .version_select at 0x7fbc3848c0d0>, body: {"keypair": {"name": "tempest-keypair-1203071489"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:23.008513 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-f4498ee5-ea78-4774-b8b4-66e9e66e25d7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:51:23.012294 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-f4498ee5-ea78-4774-b8b4-66e9e66e25d7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for user 44a64fb1ebd9411eb6156c8ef97c3072 and project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:51:23.314831 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-f4498ee5-ea78-4774-b8b4-66e9e66e25d7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:51:23.319248 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-f4498ee5-ea78-4774-b8b4-66e9e66e25d7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for user 44a64fb1ebd9411eb6156c8ef97c3072 and project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:51:23.332251 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f4498ee5-ea78-4774-b8b4-66e9e66e25d7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.351574 Apr 08 02:51:23.332832 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 264/541] 10.222.0.23 () {60 vars in 1157 bytes} [Fri Apr 8 02:51:22 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:23.601419 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9f92ed00-4064-44df-9f90-7ddb7a47f09c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:23.602061 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9f92ed00-4064-44df-9f90-7ddb7a47f09c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:23.612934 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9f92ed00-4064-44df-9f90-7ddb7a47f09c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:23.613672 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9f92ed00-4064-44df-9f90-7ddb7a47f09c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:23.614456 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9f92ed00-4064-44df-9f90-7ddb7a47f09c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:23.615203 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9f92ed00-4064-44df-9f90-7ddb7a47f09c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:23.923546 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9f92ed00-4064-44df-9f90-7ddb7a47f09c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:23.933476 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9f92ed00-4064-44df-9f90-7ddb7a47f09c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:23.934985 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9f92ed00-4064-44df-9f90-7ddb7a47f09c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:23.936312 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9f92ed00-4064-44df-9f90-7ddb7a47f09c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1407 microversion: 2.20 time: 0.338500 Apr 08 02:51:23.936894 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 278/542] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:51:23 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:51:23.986442 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-55e59a13-d918-4430-8d69-da8137e95ccf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:23.987050 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-55e59a13-d918-4430-8d69-da8137e95ccf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:23.995492 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-55e59a13-d918-4430-8d69-da8137e95ccf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:23.995949 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-55e59a13-d918-4430-8d69-da8137e95ccf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:23.996717 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-55e59a13-d918-4430-8d69-da8137e95ccf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:23.997147 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-55e59a13-d918-4430-8d69-da8137e95ccf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:24.189420 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-55e59a13-d918-4430-8d69-da8137e95ccf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:24.198603 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-55e59a13-d918-4430-8d69-da8137e95ccf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1259 microversion: 2.1 time: 0.215938 Apr 08 02:51:24.199155 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 265/543] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:23 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:24.955284 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-685d8300-d525-4c19-9882-58a5634cb4ba tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:24.955945 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-685d8300-d525-4c19-9882-58a5634cb4ba tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:24.964221 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-685d8300-d525-4c19-9882-58a5634cb4ba tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:24.964676 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-685d8300-d525-4c19-9882-58a5634cb4ba tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:24.965449 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-685d8300-d525-4c19-9882-58a5634cb4ba tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:24.965887 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-685d8300-d525-4c19-9882-58a5634cb4ba tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:25.028320 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1aa5df9f-2071-4c45-ada2-00e650139940 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-182661915", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43b1983b-07c7-47cb-8ae4-f6d4398035b6"}], "security_groups": [{"name": "tempest-securitygroup--421805645"}], "key_name": "tempest-keypair-1203071489", "user_data": "}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:25.147204 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.network.neutron [None req-1aa5df9f-2071-4c45-ada2-00e650139940 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] validate_networks() for [('43b1983b-07c7-47cb-8ae4-f6d4398035b6', None, None, None)] {{(pid=101271) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:51:25.169883 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-685d8300-d525-4c19-9882-58a5634cb4ba tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:25.179336 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-685d8300-d525-4c19-9882-58a5634cb4ba tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:25.180884 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-685d8300-d525-4c19-9882-58a5634cb4ba tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:25.182002 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-685d8300-d525-4c19-9882-58a5634cb4ba tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1407 microversion: 2.20 time: 0.230515 Apr 08 02:51:25.182559 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 279/544] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:51:24 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:51:25.215271 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-543418ec-12ce-4583-b9ec-d833872fb544 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:25.215812 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-543418ec-12ce-4583-b9ec-d833872fb544 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:25.222842 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-543418ec-12ce-4583-b9ec-d833872fb544 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:25.223285 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-543418ec-12ce-4583-b9ec-d833872fb544 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:25.224056 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-543418ec-12ce-4583-b9ec-d833872fb544 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:25.225637 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-543418ec-12ce-4583-b9ec-d833872fb544 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:25.431688 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-543418ec-12ce-4583-b9ec-d833872fb544 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:25.439980 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-543418ec-12ce-4583-b9ec-d833872fb544 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1259 microversion: 2.1 time: 0.228252 Apr 08 02:51:25.440749 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 280/545] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:25 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:25.711017 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-77f91da5-8c67-4d04-a7ef-649e5a9063e3 req-524d33b7-121a-4272-b536-3d6540f59715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66", "name": "network-vif-plugged", "status": "completed", "tag": "b1b47b52-100c-4e18-8a4a-3d16d8561d14"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:25.712802 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:25.712802 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:51:25.721724 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-77f91da5-8c67-4d04-a7ef-649e5a9063e3 req-524d33b7-121a-4272-b536-3d6540f59715 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:25.722169 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-77f91da5-8c67-4d04-a7ef-649e5a9063e3 req-524d33b7-121a-4272-b536-3d6540f59715 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:25.738329 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-77f91da5-8c67-4d04-a7ef-649e5a9063e3 req-524d33b7-121a-4272-b536-3d6540f59715 service nova] Creating event network-vif-plugged:b1b47b52-100c-4e18-8a4a-3d16d8561d14 for instance 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 on hv-cinder-83705 Apr 08 02:51:25.743864 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-77f91da5-8c67-4d04-a7ef-649e5a9063e3 req-524d33b7-121a-4272-b536-3d6540f59715 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036558 Apr 08 02:51:25.744627 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 281/546] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:51:25.773981 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-1aa5df9f-2071-4c45-ada2-00e650139940 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Flavor limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:51:25.775224 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-1aa5df9f-2071-4c45-ada2-00e650139940 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Image limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:51:25.776033 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-1aa5df9f-2071-4c45-ada2-00e650139940 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Flavor pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:51:25.776573 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-1aa5df9f-2071-4c45-ada2-00e650139940 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Image pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:51:25.777391 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-1aa5df9f-2071-4c45-ada2-00e650139940 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:51:25.786564 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1aa5df9f-2071-4c45-ada2-00e650139940 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:25.788133 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1aa5df9f-2071-4c45-ada2-00e650139940 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:25.789066 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1aa5df9f-2071-4c45-ada2-00e650139940 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:25.789571 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1aa5df9f-2071-4c45-ada2-00e650139940 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:25.809454 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-1aa5df9f-2071-4c45-ada2-00e650139940 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:51:25.813435 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-1aa5df9f-2071-4c45-ada2-00e650139940 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for user 44a64fb1ebd9411eb6156c8ef97c3072 and project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:51:25.824903 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1aa5df9f-2071-4c45-ada2-00e650139940 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Going to run 1 instances... {{(pid=101271) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:51:25.827209 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1aa5df9f-2071-4c45-ada2-00e650139940 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:51:25.873768 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1aa5df9f-2071-4c45-ada2-00e650139940 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.849609 Apr 08 02:51:25.874641 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 266/547] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:51:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 02:51:25.886067 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c960edcf-b740-4cd4-842e-7d81a963900a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:25.886908 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c960edcf-b740-4cd4-842e-7d81a963900a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:26.016362 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c960edcf-b740-4cd4-842e-7d81a963900a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:26.024889 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c960edcf-b740-4cd4-842e-7d81a963900a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1241 microversion: 2.1 time: 0.144154 Apr 08 02:51:26.025459 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 282/548] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:25 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1241 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:26.200919 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fa8b1e96-a158-4e3c-8005-07840f391c23 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:26.201622 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-fa8b1e96-a158-4e3c-8005-07840f391c23 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:26.209579 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fa8b1e96-a158-4e3c-8005-07840f391c23 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:26.210107 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fa8b1e96-a158-4e3c-8005-07840f391c23 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:26.210891 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fa8b1e96-a158-4e3c-8005-07840f391c23 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:26.211378 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fa8b1e96-a158-4e3c-8005-07840f391c23 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:26.407595 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fa8b1e96-a158-4e3c-8005-07840f391c23 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:26.416932 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fa8b1e96-a158-4e3c-8005-07840f391c23 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:26.418619 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fa8b1e96-a158-4e3c-8005-07840f391c23 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:26.419697 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-fa8b1e96-a158-4e3c-8005-07840f391c23 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1407 microversion: 2.20 time: 0.223204 Apr 08 02:51:26.420279 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 267/549] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:51:26 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:51:26.456520 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9dbe557c-4e5a-471d-897d-94c14f0b43e1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:26.457133 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9dbe557c-4e5a-471d-897d-94c14f0b43e1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:26.465899 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9dbe557c-4e5a-471d-897d-94c14f0b43e1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:26.466351 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9dbe557c-4e5a-471d-897d-94c14f0b43e1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:26.467116 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9dbe557c-4e5a-471d-897d-94c14f0b43e1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:26.467588 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9dbe557c-4e5a-471d-897d-94c14f0b43e1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:26.664219 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9dbe557c-4e5a-471d-897d-94c14f0b43e1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:26.679597 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9dbe557c-4e5a-471d-897d-94c14f0b43e1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1259 microversion: 2.1 time: 0.226418 Apr 08 02:51:26.680208 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 283/550] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:26 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:27.041844 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-20d8234b-9ed6-4968-a50e-a68203f77089 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:27.042363 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-20d8234b-9ed6-4968-a50e-a68203f77089 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:27.049582 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-20d8234b-9ed6-4968-a50e-a68203f77089 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:27.050024 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-20d8234b-9ed6-4968-a50e-a68203f77089 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:27.050776 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-20d8234b-9ed6-4968-a50e-a68203f77089 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:27.051219 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-20d8234b-9ed6-4968-a50e-a68203f77089 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:27.163064 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-20d8234b-9ed6-4968-a50e-a68203f77089 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:27.171045 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-20d8234b-9ed6-4968-a50e-a68203f77089 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1293 microversion: 2.1 time: 0.132981 Apr 08 02:51:27.171599 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 268/551] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:27 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1293 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:27.438231 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-db89b5b8-9a25-49b8-a888-be20f8e22b80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:27.439583 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-db89b5b8-9a25-49b8-a888-be20f8e22b80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:27.447285 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-db89b5b8-9a25-49b8-a888-be20f8e22b80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:27.447995 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-db89b5b8-9a25-49b8-a888-be20f8e22b80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:27.448930 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-db89b5b8-9a25-49b8-a888-be20f8e22b80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:27.449629 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-db89b5b8-9a25-49b8-a888-be20f8e22b80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:27.696967 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8704d262-e007-4a19-bb3e-7ad604d5e534 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:27.698143 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-8704d262-e007-4a19-bb3e-7ad604d5e534 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:27.705830 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8704d262-e007-4a19-bb3e-7ad604d5e534 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:27.706492 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8704d262-e007-4a19-bb3e-7ad604d5e534 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:27.707423 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8704d262-e007-4a19-bb3e-7ad604d5e534 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:27.707855 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8704d262-e007-4a19-bb3e-7ad604d5e534 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:27.741941 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-db89b5b8-9a25-49b8-a888-be20f8e22b80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:27.752357 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-db89b5b8-9a25-49b8-a888-be20f8e22b80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:27.754116 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-db89b5b8-9a25-49b8-a888-be20f8e22b80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:27.755747 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-db89b5b8-9a25-49b8-a888-be20f8e22b80 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1407 microversion: 2.20 time: 0.321087 Apr 08 02:51:27.757255 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 284/552] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:51:27 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1407 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:51:27.950092 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-8704d262-e007-4a19-bb3e-7ad604d5e534 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:27.964250 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8704d262-e007-4a19-bb3e-7ad604d5e534 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1259 microversion: 2.1 time: 0.269669 Apr 08 02:51:27.973506 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 269/553] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:27 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1259 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:28.188899 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0c34daae-1da3-490b-961b-774ca6f6562c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:28.189510 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0c34daae-1da3-490b-961b-774ca6f6562c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:28.196803 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0c34daae-1da3-490b-961b-774ca6f6562c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:28.197302 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0c34daae-1da3-490b-961b-774ca6f6562c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:28.198013 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0c34daae-1da3-490b-961b-774ca6f6562c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:28.198445 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0c34daae-1da3-490b-961b-774ca6f6562c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:28.321950 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0c34daae-1da3-490b-961b-774ca6f6562c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:28.331029 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0c34daae-1da3-490b-961b-774ca6f6562c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1299 microversion: 2.1 time: 0.145833 Apr 08 02:51:28.340761 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 285/554] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:28 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1299 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:28.775566 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-42e4af6b-2397-4327-8e7f-5d0e58ef810f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:28.776274 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-42e4af6b-2397-4327-8e7f-5d0e58ef810f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:28.783363 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-42e4af6b-2397-4327-8e7f-5d0e58ef810f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:28.783806 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-42e4af6b-2397-4327-8e7f-5d0e58ef810f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:28.784608 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-42e4af6b-2397-4327-8e7f-5d0e58ef810f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:28.785049 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-42e4af6b-2397-4327-8e7f-5d0e58ef810f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:28.976443 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-42e4af6b-2397-4327-8e7f-5d0e58ef810f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:28.981235 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9fe39e31-6283-4c94-8abb-0e4bd1e34d71 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:28.982174 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9fe39e31-6283-4c94-8abb-0e4bd1e34d71 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:28.985370 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-42e4af6b-2397-4327-8e7f-5d0e58ef810f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:28.986923 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-42e4af6b-2397-4327-8e7f-5d0e58ef810f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:28.988073 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-42e4af6b-2397-4327-8e7f-5d0e58ef810f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1599 microversion: 2.20 time: 0.217504 Apr 08 02:51:28.988951 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 270/555] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:51:28 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:51:28.989988 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9fe39e31-6283-4c94-8abb-0e4bd1e34d71 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:28.991219 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9fe39e31-6283-4c94-8abb-0e4bd1e34d71 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:28.992359 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9fe39e31-6283-4c94-8abb-0e4bd1e34d71 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:28.992898 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9fe39e31-6283-4c94-8abb-0e4bd1e34d71 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:29.007354 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-6eb54a7b-563e-43b5-aa8b-77fca9026afa tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:29.007852 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-6eb54a7b-563e-43b5-aa8b-77fca9026afa tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:29.015780 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6eb54a7b-563e-43b5-aa8b-77fca9026afa tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:29.016280 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6eb54a7b-563e-43b5-aa8b-77fca9026afa tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:29.017056 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6eb54a7b-563e-43b5-aa8b-77fca9026afa tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:29.017487 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6eb54a7b-563e-43b5-aa8b-77fca9026afa tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:29.172004 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-6eb54a7b-563e-43b5-aa8b-77fca9026afa tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.169917 Apr 08 02:51:29.180017 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 271/556] 10.222.0.23 () {60 vars in 1315 bytes} [Fri Apr 8 02:51:29 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:51:29.349438 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1c30cd4b-aefe-4979-bff5-1f42d0459a46 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:29.350563 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1c30cd4b-aefe-4979-bff5-1f42d0459a46 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:29.362838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1c30cd4b-aefe-4979-bff5-1f42d0459a46 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:29.363769 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1c30cd4b-aefe-4979-bff5-1f42d0459a46 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:29.365219 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1c30cd4b-aefe-4979-bff5-1f42d0459a46 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:29.365769 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1c30cd4b-aefe-4979-bff5-1f42d0459a46 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:29.519203 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9fe39e31-6283-4c94-8abb-0e4bd1e34d71 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:29.531260 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9fe39e31-6283-4c94-8abb-0e4bd1e34d71 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1259 microversion: 2.1 time: 0.553669 Apr 08 02:51:29.532399 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 286/557] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:28 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1259 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:29.692755 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-b62e38b5-4953-4092-aedb-be0cb69315f4 req-b4a7e6e2-98de-4e00-9f46-3b0c2137f5ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d509168a-9e7c-4ff6-b331-343f649a2944", "tag": "15ea6272-ea85-47cf-ad3d-80473f241c2d"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:29.697113 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:29.697113 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:51:29.713406 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-b62e38b5-4953-4092-aedb-be0cb69315f4 req-b4a7e6e2-98de-4e00-9f46-3b0c2137f5ca service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:29.714024 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-b62e38b5-4953-4092-aedb-be0cb69315f4 req-b4a7e6e2-98de-4e00-9f46-3b0c2137f5ca service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:29.734155 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-b62e38b5-4953-4092-aedb-be0cb69315f4 req-b4a7e6e2-98de-4e00-9f46-3b0c2137f5ca service nova] Creating event network-changed:15ea6272-ea85-47cf-ad3d-80473f241c2d for instance d509168a-9e7c-4ff6-b331-343f649a2944 on hv-cinder-83705 Apr 08 02:51:29.739080 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-b62e38b5-4953-4092-aedb-be0cb69315f4 req-b4a7e6e2-98de-4e00-9f46-3b0c2137f5ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051444 Apr 08 02:51:29.741444 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 287/558] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:29.766824 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1c30cd4b-aefe-4979-bff5-1f42d0459a46 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:29.779146 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1c30cd4b-aefe-4979-bff5-1f42d0459a46 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1366 microversion: 2.1 time: 0.433483 Apr 08 02:51:29.780175 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 272/559] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:29 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1366 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:29.853869 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-b0b94ab8-9947-4711-8ab2-3e3ce06227d1 req-925ea522-3351-4335-91fb-187fab154d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c826480b-a813-4281-83a6-c743d8a84b9c", "name": "network-vif-plugged", "status": "completed", "tag": "105b6cec-7cb5-414f-809c-11a2bc5ec384"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:29.855902 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:29.855902 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:51:29.866380 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-b0b94ab8-9947-4711-8ab2-3e3ce06227d1 req-925ea522-3351-4335-91fb-187fab154d75 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:29.867101 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-b0b94ab8-9947-4711-8ab2-3e3ce06227d1 req-925ea522-3351-4335-91fb-187fab154d75 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:29.901504 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-b0b94ab8-9947-4711-8ab2-3e3ce06227d1 req-925ea522-3351-4335-91fb-187fab154d75 service nova] Creating event network-vif-plugged:105b6cec-7cb5-414f-809c-11a2bc5ec384 for instance c826480b-a813-4281-83a6-c743d8a84b9c on hv-cinder-83705 Apr 08 02:51:29.914872 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-b0b94ab8-9947-4711-8ab2-3e3ce06227d1 req-925ea522-3351-4335-91fb-187fab154d75 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067246 Apr 08 02:51:29.922222 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 288/560] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:30.548360 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-3dfa6c18-bfe2-4895-bd5e-76dd19e2d9e4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:30.549319 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-3dfa6c18-bfe2-4895-bd5e-76dd19e2d9e4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:30.557961 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3dfa6c18-bfe2-4895-bd5e-76dd19e2d9e4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:30.558666 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3dfa6c18-bfe2-4895-bd5e-76dd19e2d9e4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:30.559668 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3dfa6c18-bfe2-4895-bd5e-76dd19e2d9e4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:30.560326 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3dfa6c18-bfe2-4895-bd5e-76dd19e2d9e4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:30.797393 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-cc63a1d2-a709-4a92-b9bc-fbfb1b874da9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:30.798712 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-cc63a1d2-a709-4a92-b9bc-fbfb1b874da9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:30.806345 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cc63a1d2-a709-4a92-b9bc-fbfb1b874da9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:30.806794 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cc63a1d2-a709-4a92-b9bc-fbfb1b874da9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:30.807566 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cc63a1d2-a709-4a92-b9bc-fbfb1b874da9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:30.808030 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cc63a1d2-a709-4a92-b9bc-fbfb1b874da9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:30.881077 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3dfa6c18-bfe2-4895-bd5e-76dd19e2d9e4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:30.889815 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-3dfa6c18-bfe2-4895-bd5e-76dd19e2d9e4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1259 microversion: 2.1 time: 0.345054 Apr 08 02:51:30.890544 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 273/561] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:30 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1259 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:31.130325 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-f3ae7e9e-06b9-401c-9436-6ac06af0e2a7 req-b05bea55-6735-4019-b554-a396a3b831aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66", "tag": "b1b47b52-100c-4e18-8a4a-3d16d8561d14"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:31.132396 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:31.132396 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:51:31.140588 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-f3ae7e9e-06b9-401c-9436-6ac06af0e2a7 req-b05bea55-6735-4019-b554-a396a3b831aa service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:31.141543 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-f3ae7e9e-06b9-401c-9436-6ac06af0e2a7 req-b05bea55-6735-4019-b554-a396a3b831aa service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:31.142368 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cc63a1d2-a709-4a92-b9bc-fbfb1b874da9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:31.151125 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-cc63a1d2-a709-4a92-b9bc-fbfb1b874da9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1366 microversion: 2.1 time: 0.357862 Apr 08 02:51:31.162175 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-f3ae7e9e-06b9-401c-9436-6ac06af0e2a7 req-b05bea55-6735-4019-b554-a396a3b831aa service nova] Creating event network-changed:b1b47b52-100c-4e18-8a4a-3d16d8561d14 for instance 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 on hv-cinder-83705 Apr 08 02:51:31.162652 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 289/562] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:30 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:31.165433 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-f3ae7e9e-06b9-401c-9436-6ac06af0e2a7 req-b05bea55-6735-4019-b554-a396a3b831aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043056 Apr 08 02:51:31.166626 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 274/563] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:31.906424 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2d092ae4-b69a-41bf-bd81-ebfd48536d4a tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:31.907035 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2d092ae4-b69a-41bf-bd81-ebfd48536d4a tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:31.915255 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2d092ae4-b69a-41bf-bd81-ebfd48536d4a tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:31.915711 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2d092ae4-b69a-41bf-bd81-ebfd48536d4a tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:31.916532 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2d092ae4-b69a-41bf-bd81-ebfd48536d4a tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:31.916973 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2d092ae4-b69a-41bf-bd81-ebfd48536d4a tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:32.117557 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2d092ae4-b69a-41bf-bd81-ebfd48536d4a tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:32.125746 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2d092ae4-b69a-41bf-bd81-ebfd48536d4a tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1259 microversion: 2.1 time: 0.223000 Apr 08 02:51:32.126319 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 290/564] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:31 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:32.169822 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8ebc7603-0279-446c-8f92-10ecb19ada30 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:32.170534 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-8ebc7603-0279-446c-8f92-10ecb19ada30 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:32.178748 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8ebc7603-0279-446c-8f92-10ecb19ada30 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:32.179453 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8ebc7603-0279-446c-8f92-10ecb19ada30 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:32.180282 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8ebc7603-0279-446c-8f92-10ecb19ada30 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:32.182204 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8ebc7603-0279-446c-8f92-10ecb19ada30 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:32.393348 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-8ebc7603-0279-446c-8f92-10ecb19ada30 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:32.403719 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8ebc7603-0279-446c-8f92-10ecb19ada30 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1366 microversion: 2.1 time: 0.238340 Apr 08 02:51:32.404552 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 275/565] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:32 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:33.142992 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1bd1d97e-6423-4b2f-8ec5-7c2d4eefd8aa tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:33.143613 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1bd1d97e-6423-4b2f-8ec5-7c2d4eefd8aa tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:33.151487 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1bd1d97e-6423-4b2f-8ec5-7c2d4eefd8aa tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:33.151949 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1bd1d97e-6423-4b2f-8ec5-7c2d4eefd8aa tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:33.152737 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1bd1d97e-6423-4b2f-8ec5-7c2d4eefd8aa tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:33.153192 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1bd1d97e-6423-4b2f-8ec5-7c2d4eefd8aa tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:33.352476 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1bd1d97e-6423-4b2f-8ec5-7c2d4eefd8aa tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:33.360634 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1bd1d97e-6423-4b2f-8ec5-7c2d4eefd8aa tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1443 microversion: 2.1 time: 0.221371 Apr 08 02:51:33.361200 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 291/566] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:33 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1443 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:33.376334 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-9ce5df18-10ec-4984-8a3c-95df0ebb6ba4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:33.376979 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-9ce5df18-10ec-4984-8a3c-95df0ebb6ba4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:33.384928 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9ce5df18-10ec-4984-8a3c-95df0ebb6ba4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:33.385376 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9ce5df18-10ec-4984-8a3c-95df0ebb6ba4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:33.386145 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9ce5df18-10ec-4984-8a3c-95df0ebb6ba4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:33.386579 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9ce5df18-10ec-4984-8a3c-95df0ebb6ba4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:33.421042 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f5e2ce68-40a3-4c4a-b23f-d2559a3a72d0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:33.421604 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f5e2ce68-40a3-4c4a-b23f-d2559a3a72d0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:33.429456 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f5e2ce68-40a3-4c4a-b23f-d2559a3a72d0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:33.429909 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f5e2ce68-40a3-4c4a-b23f-d2559a3a72d0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:33.430800 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f5e2ce68-40a3-4c4a-b23f-d2559a3a72d0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:33.431224 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f5e2ce68-40a3-4c4a-b23f-d2559a3a72d0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:33.595687 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-9ce5df18-10ec-4984-8a3c-95df0ebb6ba4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:33.604563 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-9ce5df18-10ec-4984-8a3c-95df0ebb6ba4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1443 microversion: 2.1 time: 0.231859 Apr 08 02:51:33.605309 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 276/567] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:33 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1443 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:33.633988 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f5e2ce68-40a3-4c4a-b23f-d2559a3a72d0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:33.642029 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f5e2ce68-40a3-4c4a-b23f-d2559a3a72d0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1366 microversion: 2.1 time: 0.224713 Apr 08 02:51:33.642619 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 292/568] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:33 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:34.658848 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a8506778-24e6-4d9c-be5f-1ccb07c4625b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:34.659459 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a8506778-24e6-4d9c-be5f-1ccb07c4625b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:34.667134 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a8506778-24e6-4d9c-be5f-1ccb07c4625b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:34.667587 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a8506778-24e6-4d9c-be5f-1ccb07c4625b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:34.668420 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a8506778-24e6-4d9c-be5f-1ccb07c4625b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:34.668862 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a8506778-24e6-4d9c-be5f-1ccb07c4625b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:35.029678 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a8506778-24e6-4d9c-be5f-1ccb07c4625b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:35.038386 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a8506778-24e6-4d9c-be5f-1ccb07c4625b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1366 microversion: 2.1 time: 0.383327 Apr 08 02:51:35.038953 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 277/569] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:34 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:36.055287 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3de7001c-3bc1-496b-bbae-60a4a28071a8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:36.055953 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-3de7001c-3bc1-496b-bbae-60a4a28071a8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:36.063493 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3de7001c-3bc1-496b-bbae-60a4a28071a8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:36.063975 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3de7001c-3bc1-496b-bbae-60a4a28071a8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:36.064760 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3de7001c-3bc1-496b-bbae-60a4a28071a8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:36.065193 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3de7001c-3bc1-496b-bbae-60a4a28071a8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:36.265884 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-3de7001c-3bc1-496b-bbae-60a4a28071a8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:36.275352 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3de7001c-3bc1-496b-bbae-60a4a28071a8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1366 microversion: 2.1 time: 0.224360 Apr 08 02:51:36.275944 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 293/570] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:36 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:36.849733 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-2f12c48d-05c8-4dc1-9764-84f243e1db06 req-75e9695c-5851-472b-a67c-86c87528cb88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c826480b-a813-4281-83a6-c743d8a84b9c", "tag": "105b6cec-7cb5-414f-809c-11a2bc5ec384"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:36.851243 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:36.851243 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:51:36.859594 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-2f12c48d-05c8-4dc1-9764-84f243e1db06 req-75e9695c-5851-472b-a67c-86c87528cb88 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:36.860074 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-2f12c48d-05c8-4dc1-9764-84f243e1db06 req-75e9695c-5851-472b-a67c-86c87528cb88 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:36.876337 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-2f12c48d-05c8-4dc1-9764-84f243e1db06 req-75e9695c-5851-472b-a67c-86c87528cb88 service nova] Creating event network-changed:105b6cec-7cb5-414f-809c-11a2bc5ec384 for instance c826480b-a813-4281-83a6-c743d8a84b9c on hv-cinder-83705 Apr 08 02:51:36.882134 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-2f12c48d-05c8-4dc1-9764-84f243e1db06 req-75e9695c-5851-472b-a67c-86c87528cb88 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036558 Apr 08 02:51:36.882730 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 278/571] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:37.291610 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-efe61bd8-d7e0-454a-9c2e-ccf48d3a9c48 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:37.293003 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-efe61bd8-d7e0-454a-9c2e-ccf48d3a9c48 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:37.300386 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-efe61bd8-d7e0-454a-9c2e-ccf48d3a9c48 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:37.300841 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-efe61bd8-d7e0-454a-9c2e-ccf48d3a9c48 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:37.301615 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-efe61bd8-d7e0-454a-9c2e-ccf48d3a9c48 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:37.302078 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-efe61bd8-d7e0-454a-9c2e-ccf48d3a9c48 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:37.522705 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-efe61bd8-d7e0-454a-9c2e-ccf48d3a9c48 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:37.531599 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-efe61bd8-d7e0-454a-9c2e-ccf48d3a9c48 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1366 microversion: 2.1 time: 0.243729 Apr 08 02:51:37.532585 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 294/572] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:37 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:38.109467 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-4b0e248e-8c36-4cb6-b5f4-66aca9f364a2 req-9631c28e-63e5-4102-a4dc-6e0cfbcb03c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d509168a-9e7c-4ff6-b331-343f649a2944", "name": "network-vif-plugged", "status": "completed", "tag": "15ea6272-ea85-47cf-ad3d-80473f241c2d"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:38.110979 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:38.110979 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:51:38.120752 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-4b0e248e-8c36-4cb6-b5f4-66aca9f364a2 req-9631c28e-63e5-4102-a4dc-6e0cfbcb03c6 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:38.121196 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-4b0e248e-8c36-4cb6-b5f4-66aca9f364a2 req-9631c28e-63e5-4102-a4dc-6e0cfbcb03c6 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:38.137064 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-4b0e248e-8c36-4cb6-b5f4-66aca9f364a2 req-9631c28e-63e5-4102-a4dc-6e0cfbcb03c6 service nova] Creating event network-vif-plugged:15ea6272-ea85-47cf-ad3d-80473f241c2d for instance d509168a-9e7c-4ff6-b331-343f649a2944 on hv-cinder-83705 Apr 08 02:51:38.141733 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-4b0e248e-8c36-4cb6-b5f4-66aca9f364a2 req-9631c28e-63e5-4102-a4dc-6e0cfbcb03c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036299 Apr 08 02:51:38.142332 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 279/573] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:38.550406 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-7e730484-9162-4d67-b5b1-22e91e24c3e1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:38.551014 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-7e730484-9162-4d67-b5b1-22e91e24c3e1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:38.559348 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7e730484-9162-4d67-b5b1-22e91e24c3e1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:38.559793 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7e730484-9162-4d67-b5b1-22e91e24c3e1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:38.560632 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7e730484-9162-4d67-b5b1-22e91e24c3e1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:38.561061 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7e730484-9162-4d67-b5b1-22e91e24c3e1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:38.763144 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-7e730484-9162-4d67-b5b1-22e91e24c3e1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:38.771758 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-7e730484-9162-4d67-b5b1-22e91e24c3e1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1366 microversion: 2.1 time: 0.224462 Apr 08 02:51:38.772344 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 295/574] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:38 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:39.789533 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-355fcf90-28bb-4579-80fe-5b016ef026ab tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:39.790149 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-355fcf90-28bb-4579-80fe-5b016ef026ab tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:39.797549 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-355fcf90-28bb-4579-80fe-5b016ef026ab tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:39.797993 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-355fcf90-28bb-4579-80fe-5b016ef026ab tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:39.798748 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-355fcf90-28bb-4579-80fe-5b016ef026ab tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:39.799176 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-355fcf90-28bb-4579-80fe-5b016ef026ab tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:40.002830 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-355fcf90-28bb-4579-80fe-5b016ef026ab tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:40.011641 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-355fcf90-28bb-4579-80fe-5b016ef026ab tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1366 microversion: 2.1 time: 0.226888 Apr 08 02:51:40.012237 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 280/575] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:39 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:41.028273 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-509e22d9-4d46-4586-b33d-50e54ce07bbd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:41.028885 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-509e22d9-4d46-4586-b33d-50e54ce07bbd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:41.036072 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-509e22d9-4d46-4586-b33d-50e54ce07bbd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:41.037013 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-509e22d9-4d46-4586-b33d-50e54ce07bbd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:41.037761 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-509e22d9-4d46-4586-b33d-50e54ce07bbd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:41.038184 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-509e22d9-4d46-4586-b33d-50e54ce07bbd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:41.234969 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-509e22d9-4d46-4586-b33d-50e54ce07bbd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:41.243281 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-509e22d9-4d46-4586-b33d-50e54ce07bbd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1556 microversion: 2.1 time: 0.218663 Apr 08 02:51:41.243841 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 296/576] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:41 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1556 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:41.259137 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1310e1fb-87b6-4112-bd7a-8c95d02893bb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:41.259673 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1310e1fb-87b6-4112-bd7a-8c95d02893bb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:41.266728 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1310e1fb-87b6-4112-bd7a-8c95d02893bb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:41.267177 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1310e1fb-87b6-4112-bd7a-8c95d02893bb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:41.267956 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1310e1fb-87b6-4112-bd7a-8c95d02893bb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:41.268399 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1310e1fb-87b6-4112-bd7a-8c95d02893bb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:41.408782 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1310e1fb-87b6-4112-bd7a-8c95d02893bb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.153350 Apr 08 02:51:41.409370 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 281/577] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Apr 8 02:51:41 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944/os-interface => generated 285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:42.953462 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-f3b5bf3b-3288-47bb-9f9b-86a3e190abe4 req-b12fa11a-2cad-46e9-9af3-578c4c8203f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d509168a-9e7c-4ff6-b331-343f649a2944", "tag": "15ea6272-ea85-47cf-ad3d-80473f241c2d"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:42.956486 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:42.956486 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:51:42.970813 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-f3b5bf3b-3288-47bb-9f9b-86a3e190abe4 req-b12fa11a-2cad-46e9-9af3-578c4c8203f3 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:42.971605 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-f3b5bf3b-3288-47bb-9f9b-86a3e190abe4 req-b12fa11a-2cad-46e9-9af3-578c4c8203f3 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:43.002141 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-f3b5bf3b-3288-47bb-9f9b-86a3e190abe4 req-b12fa11a-2cad-46e9-9af3-578c4c8203f3 service nova] Creating event network-changed:15ea6272-ea85-47cf-ad3d-80473f241c2d for instance d509168a-9e7c-4ff6-b331-343f649a2944 on hv-cinder-83705 Apr 08 02:51:43.010970 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-f3b5bf3b-3288-47bb-9f9b-86a3e190abe4 req-b12fa11a-2cad-46e9-9af3-578c4c8203f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070073 Apr 08 02:51:43.012209 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 297/578] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:55.614447 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8e56fe18-db49-4c92-8823-15334c827e09 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:55.615016 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-8e56fe18-db49-4c92-8823-15334c827e09 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:55.622428 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8e56fe18-db49-4c92-8823-15334c827e09 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:55.622889 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8e56fe18-db49-4c92-8823-15334c827e09 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:55.623655 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8e56fe18-db49-4c92-8823-15334c827e09 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:55.624132 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8e56fe18-db49-4c92-8823-15334c827e09 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:55.769872 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.objects.instance [None req-8e56fe18-db49-4c92-8823-15334c827e09 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lazy-loading 'services' on Instance uuid 06827ced-06c8-40dd-9ad3-3b5d02590d00 {{(pid=101271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:51:55.909919 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8e56fe18-db49-4c92-8823-15334c827e09 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "DELETE /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/os-volume_attachments/9f1b9b51-a546-4f36-8da5-03fc03d16ccf" status: 202 len: 0 microversion: 2.1 time: 0.299033 Apr 08 02:51:55.910790 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 282/579] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Apr 8 02:51:55 2022] DELETE /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/os-volume_attachments/9f1b9b51-a546-4f36-8da5-03fc03d16ccf => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:51:55.919429 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e72b659f-b203-48fa-a0ae-859e7a09c2c1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:55.920471 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e72b659f-b203-48fa-a0ae-859e7a09c2c1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:55.927899 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e72b659f-b203-48fa-a0ae-859e7a09c2c1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:55.928386 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e72b659f-b203-48fa-a0ae-859e7a09c2c1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:55.929169 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e72b659f-b203-48fa-a0ae-859e7a09c2c1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:55.929911 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e72b659f-b203-48fa-a0ae-859e7a09c2c1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:55.995224 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e72b659f-b203-48fa-a0ae-859e7a09c2c1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080012 Apr 08 02:51:55.995784 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 298/580] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:51:55 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:57.008164 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-9b59f049-8c78-4a0a-9145-14ce4fbe89a1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:57.009254 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-9b59f049-8c78-4a0a-9145-14ce4fbe89a1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:57.016699 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9b59f049-8c78-4a0a-9145-14ce4fbe89a1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:57.017152 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9b59f049-8c78-4a0a-9145-14ce4fbe89a1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:57.017924 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9b59f049-8c78-4a0a-9145-14ce4fbe89a1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:57.018365 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9b59f049-8c78-4a0a-9145-14ce4fbe89a1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:57.081545 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-9b59f049-8c78-4a0a-9145-14ce4fbe89a1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078357 Apr 08 02:51:57.082019 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 283/581] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:51:57 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:58.092921 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c1e861d4-b500-4789-ab5b-7fd6c4ae7c04 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:58.093839 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c1e861d4-b500-4789-ab5b-7fd6c4ae7c04 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:58.101602 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c1e861d4-b500-4789-ab5b-7fd6c4ae7c04 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.102042 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c1e861d4-b500-4789-ab5b-7fd6c4ae7c04 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:58.102797 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c1e861d4-b500-4789-ab5b-7fd6c4ae7c04 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.103225 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c1e861d4-b500-4789-ab5b-7fd6c4ae7c04 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:58.165458 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c1e861d4-b500-4789-ab5b-7fd6c4ae7c04 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076280 Apr 08 02:51:58.166017 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 299/582] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:51:58 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:51:58.268182 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-edb061b4-00b4-4939-8893-d86773f89222 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:58.268750 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-edb061b4-00b4-4939-8893-d86773f89222 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:58.276027 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-edb061b4-00b4-4939-8893-d86773f89222 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.276475 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-edb061b4-00b4-4939-8893-d86773f89222 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:58.277237 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-edb061b4-00b4-4939-8893-d86773f89222 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.277674 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-edb061b4-00b4-4939-8893-d86773f89222 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:58.319061 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3b8e0c08-6be7-4236-8890-fe7bb0b73e53 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:58.320103 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-3b8e0c08-6be7-4236-8890-fe7bb0b73e53 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:58.327171 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3b8e0c08-6be7-4236-8890-fe7bb0b73e53 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.327609 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3b8e0c08-6be7-4236-8890-fe7bb0b73e53 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:58.328407 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3b8e0c08-6be7-4236-8890-fe7bb0b73e53 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.328831 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3b8e0c08-6be7-4236-8890-fe7bb0b73e53 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:58.351747 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-edb061b4-00b4-4939-8893-d86773f89222 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Going to try to terminate instance {{(pid=101271) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:51:58.407949 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3b8e0c08-6be7-4236-8890-fe7bb0b73e53 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092572 Apr 08 02:51:58.408750 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 300/583] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:51:58 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 02:51:58.472633 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-edb061b4-00b4-4939-8893-d86773f89222 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "DELETE /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 204 len: 0 microversion: 2.1 time: 0.207799 Apr 08 02:51:58.473463 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 284/584] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:51:58 2022] DELETE /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:51:58.483472 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-fed0cd26-a459-48ff-9568-58032d14ff3d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:58.484532 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-fed0cd26-a459-48ff-9568-58032d14ff3d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:58.502400 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fed0cd26-a459-48ff-9568-58032d14ff3d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.502852 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fed0cd26-a459-48ff-9568-58032d14ff3d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:58.503620 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fed0cd26-a459-48ff-9568-58032d14ff3d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.504267 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fed0cd26-a459-48ff-9568-58032d14ff3d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:58.506725 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-dbab7282-90c7-47eb-adf5-153af617f76a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:58.507312 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-dbab7282-90c7-47eb-adf5-153af617f76a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:58.514594 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-dbab7282-90c7-47eb-adf5-153af617f76a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.515035 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-dbab7282-90c7-47eb-adf5-153af617f76a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:58.515846 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-dbab7282-90c7-47eb-adf5-153af617f76a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.516281 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-dbab7282-90c7-47eb-adf5-153af617f76a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:58.582443 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-dbab7282-90c7-47eb-adf5-153af617f76a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Going to try to terminate instance {{(pid=101271) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:51:58.705407 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-dbab7282-90c7-47eb-adf5-153af617f76a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 204 len: 0 microversion: 2.1 time: 0.203399 Apr 08 02:51:58.709651 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 285/585] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:51:58 2022] DELETE /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 02:51:58.715084 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f78a11a4-dc3a-452e-96c4-006d244a2f5b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:58.715772 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f78a11a4-dc3a-452e-96c4-006d244a2f5b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:58.722808 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f78a11a4-dc3a-452e-96c4-006d244a2f5b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.723228 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-fed0cd26-a459-48ff-9568-58032d14ff3d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:58.723354 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f78a11a4-dc3a-452e-96c4-006d244a2f5b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:58.724881 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f78a11a4-dc3a-452e-96c4-006d244a2f5b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.725333 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f78a11a4-dc3a-452e-96c4-006d244a2f5b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:58.732617 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-fed0cd26-a459-48ff-9568-58032d14ff3d tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1691 microversion: 2.1 time: 0.253818 Apr 08 02:51:58.733215 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 301/586] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:58 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1691 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:58.916776 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f78a11a4-dc3a-452e-96c4-006d244a2f5b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:58.924886 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f78a11a4-dc3a-452e-96c4-006d244a2f5b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1671 microversion: 2.1 time: 0.213870 Apr 08 02:51:58.925457 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 286/587] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:58 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1671 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:59.749712 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1dc4682d-481f-40b3-8869-2424af81f50e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:59.750357 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1dc4682d-481f-40b3-8869-2424af81f50e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:59.758040 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1dc4682d-481f-40b3-8869-2424af81f50e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:59.758490 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1dc4682d-481f-40b3-8869-2424af81f50e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:59.759301 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1dc4682d-481f-40b3-8869-2424af81f50e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:59.759689 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1dc4682d-481f-40b3-8869-2424af81f50e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:59.942080 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-26b4cdf9-7055-4fbd-a1fe-e8b5819dcfa0 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:59.943319 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-26b4cdf9-7055-4fbd-a1fe-e8b5819dcfa0 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:51:59.950622 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-26b4cdf9-7055-4fbd-a1fe-e8b5819dcfa0 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:59.951061 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-26b4cdf9-7055-4fbd-a1fe-e8b5819dcfa0 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:59.951824 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-26b4cdf9-7055-4fbd-a1fe-e8b5819dcfa0 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:59.952454 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-26b4cdf9-7055-4fbd-a1fe-e8b5819dcfa0 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:59.955453 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1dc4682d-481f-40b3-8869-2424af81f50e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:51:59.964983 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1dc4682d-481f-40b3-8869-2424af81f50e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1691 microversion: 2.1 time: 0.219008 Apr 08 02:51:59.965658 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 302/588] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:59 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1691 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:00.155561 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-26b4cdf9-7055-4fbd-a1fe-e8b5819dcfa0 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:00.164572 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-26b4cdf9-7055-4fbd-a1fe-e8b5819dcfa0 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1671 microversion: 2.1 time: 0.226365 Apr 08 02:52:00.165125 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 287/589] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:59 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1671 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:52:00.982147 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-39bbc141-01f0-4b70-91a1-71bc94a23863 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:00.983318 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-39bbc141-01f0-4b70-91a1-71bc94a23863 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:00.991539 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-39bbc141-01f0-4b70-91a1-71bc94a23863 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:00.992030 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-39bbc141-01f0-4b70-91a1-71bc94a23863 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:00.992813 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-39bbc141-01f0-4b70-91a1-71bc94a23863 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:00.993253 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-39bbc141-01f0-4b70-91a1-71bc94a23863 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:01.182413 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-12f37b9b-b255-4812-bbbb-3c4b699ed4c5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:01.184259 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-12f37b9b-b255-4812-bbbb-3c4b699ed4c5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:01.196431 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-12f37b9b-b255-4812-bbbb-3c4b699ed4c5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:01.196905 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-12f37b9b-b255-4812-bbbb-3c4b699ed4c5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:01.197717 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-12f37b9b-b255-4812-bbbb-3c4b699ed4c5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:01.198940 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-12f37b9b-b255-4812-bbbb-3c4b699ed4c5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:01.199456 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-39bbc141-01f0-4b70-91a1-71bc94a23863 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:01.210536 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-39bbc141-01f0-4b70-91a1-71bc94a23863 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1691 microversion: 2.1 time: 0.231901 Apr 08 02:52:01.212236 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 303/590] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:00 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1691 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:01.572336 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-12f37b9b-b255-4812-bbbb-3c4b699ed4c5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:01.580667 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-12f37b9b-b255-4812-bbbb-3c4b699ed4c5 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1671 microversion: 2.1 time: 0.402638 Apr 08 02:52:01.581266 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 288/591] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:01 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1671 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:01.940699 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-9731c324-5731-451b-a697-cf3bdb5c97a7 req-5fe41f28-b76d-4b54-a136-7957f263a8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff7e510d-5c97-4291-930a-66cd4b8d6137", "name": "network-vif-deleted", "tag": "0ed67e44-5f92-4862-acd5-9fec0333c514"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:01.942735 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:01.942735 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:52:01.957063 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-9731c324-5731-451b-a697-cf3bdb5c97a7 req-5fe41f28-b76d-4b54-a136-7957f263a8b4 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:01.957585 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-9731c324-5731-451b-a697-cf3bdb5c97a7 req-5fe41f28-b76d-4b54-a136-7957f263a8b4 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:01.977603 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-9731c324-5731-451b-a697-cf3bdb5c97a7 req-5fe41f28-b76d-4b54-a136-7957f263a8b4 service nova] Creating event network-vif-deleted:0ed67e44-5f92-4862-acd5-9fec0333c514 for instance ff7e510d-5c97-4291-930a-66cd4b8d6137 on hv-cinder-83705 Apr 08 02:52:01.982677 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-9731c324-5731-451b-a697-cf3bdb5c97a7 req-5fe41f28-b76d-4b54-a136-7957f263a8b4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045935 Apr 08 02:52:01.983649 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 304/592] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:02.228927 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-05182a5e-7d80-4294-acfd-416f75058c72 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:02.229597 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-05182a5e-7d80-4294-acfd-416f75058c72 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:02.236944 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-05182a5e-7d80-4294-acfd-416f75058c72 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:02.237395 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-05182a5e-7d80-4294-acfd-416f75058c72 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:02.238155 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-05182a5e-7d80-4294-acfd-416f75058c72 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:02.238587 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-05182a5e-7d80-4294-acfd-416f75058c72 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:02.437028 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-05182a5e-7d80-4294-acfd-416f75058c72 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:02.446240 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-05182a5e-7d80-4294-acfd-416f75058c72 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1691 microversion: 2.1 time: 0.221275 Apr 08 02:52:02.446812 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 289/593] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:02 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1691 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:02.599392 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-17e3ca00-7dac-4435-861f-5196631ee67a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:02.600142 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-17e3ca00-7dac-4435-861f-5196631ee67a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:02.608747 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-17e3ca00-7dac-4435-861f-5196631ee67a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:02.609234 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-17e3ca00-7dac-4435-861f-5196631ee67a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:02.610006 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-17e3ca00-7dac-4435-861f-5196631ee67a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:02.610453 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-17e3ca00-7dac-4435-861f-5196631ee67a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:02.687851 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-17e3ca00-7dac-4435-861f-5196631ee67a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:02.688340 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-17e3ca00-7dac-4435-861f-5196631ee67a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:02.688797 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.objects.instance [None req-17e3ca00-7dac-4435-861f-5196631ee67a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lazy-loading 'fault' on Instance uuid ff7e510d-5c97-4291-930a-66cd4b8d6137 {{(pid=101272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:52:02.746447 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-17e3ca00-7dac-4435-861f-5196631ee67a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:02.754994 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-17e3ca00-7dac-4435-861f-5196631ee67a tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 200 len: 1326 microversion: 2.1 time: 0.160146 Apr 08 02:52:02.755556 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 305/594] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:02 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 1326 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:03.462444 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-57c87be7-d7e2-46ca-9ae6-6fb79fe5db5e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:03.463149 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-57c87be7-d7e2-46ca-9ae6-6fb79fe5db5e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:03.470584 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-57c87be7-d7e2-46ca-9ae6-6fb79fe5db5e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:03.471106 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-57c87be7-d7e2-46ca-9ae6-6fb79fe5db5e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:03.471953 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-57c87be7-d7e2-46ca-9ae6-6fb79fe5db5e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:03.472480 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-57c87be7-d7e2-46ca-9ae6-6fb79fe5db5e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:03.772184 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3019555d-1818-455b-bfea-0e8a8603da67 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:03.772752 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-3019555d-1818-455b-bfea-0e8a8603da67 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:03.779901 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3019555d-1818-455b-bfea-0e8a8603da67 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:03.780383 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3019555d-1818-455b-bfea-0e8a8603da67 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:03.781160 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3019555d-1818-455b-bfea-0e8a8603da67 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:03.781605 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3019555d-1818-455b-bfea-0e8a8603da67 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:03.834257 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-3019555d-1818-455b-bfea-0e8a8603da67 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] HTTP exception thrown: Instance ff7e510d-5c97-4291-930a-66cd4b8d6137 could not be found. Apr 08 02:52:03.835104 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3019555d-1818-455b-bfea-0e8a8603da67 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Returning 404 to user: Instance ff7e510d-5c97-4291-930a-66cd4b8d6137 could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:52:03.835963 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3019555d-1818-455b-bfea-0e8a8603da67 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 404 len: 111 microversion: 2.1 time: 0.067704 Apr 08 02:52:03.836730 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 306/595] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:03 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:52:03.844349 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-70d09a33-c8a4-4955-92e1-d1df3d5b5667 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '.version_select at 0x7fbc3849f5e0>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:03.861533 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-70d09a33-c8a4-4955-92e1-d1df3d5b5667 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-29480757" status: 202 len: 0 microversion: 2.1 time: 0.020547 Apr 08 02:52:03.862427 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 307/596] 10.222.0.23 () {58 vars in 1214 bytes} [Fri Apr 8 02:52:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-29480757 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 02:52:03.911680 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-57c87be7-d7e2-46ca-9ae6-6fb79fe5db5e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:03.919960 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-57c87be7-d7e2-46ca-9ae6-6fb79fe5db5e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1691 microversion: 2.1 time: 0.461224 Apr 08 02:52:03.920542 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 290/597] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:03 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1691 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:04.605479 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-5a8265b5-f2b1-4847-9fb2-8c378ab24807 req-b51a4750-4a7a-4dec-99a5-a3a829acbbcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06827ced-06c8-40dd-9ad3-3b5d02590d00", "name": "network-vif-deleted", "tag": "32e13942-1502-4bda-aca8-d69e5aacf04a"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:04.607498 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:04.607498 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:52:04.623071 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-5a8265b5-f2b1-4847-9fb2-8c378ab24807 req-b51a4750-4a7a-4dec-99a5-a3a829acbbcb service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:04.623790 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-5a8265b5-f2b1-4847-9fb2-8c378ab24807 req-b51a4750-4a7a-4dec-99a5-a3a829acbbcb service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:04.654344 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-5a8265b5-f2b1-4847-9fb2-8c378ab24807 req-b51a4750-4a7a-4dec-99a5-a3a829acbbcb service nova] Creating event network-vif-deleted:32e13942-1502-4bda-aca8-d69e5aacf04a for instance 06827ced-06c8-40dd-9ad3-3b5d02590d00 on hv-cinder-83705 Apr 08 02:52:04.659249 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-5a8265b5-f2b1-4847-9fb2-8c378ab24807 req-b51a4750-4a7a-4dec-99a5-a3a829acbbcb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063636 Apr 08 02:52:04.659848 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 308/598] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:04.940988 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-23cf98e8-d393-47aa-9cef-30bcc2d7a3e1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:04.941844 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-23cf98e8-d393-47aa-9cef-30bcc2d7a3e1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:04.951052 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23cf98e8-d393-47aa-9cef-30bcc2d7a3e1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:04.951642 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23cf98e8-d393-47aa-9cef-30bcc2d7a3e1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:04.952649 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23cf98e8-d393-47aa-9cef-30bcc2d7a3e1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:04.953063 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23cf98e8-d393-47aa-9cef-30bcc2d7a3e1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:04.980216 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c1e407fd-feb3-41d1-a6b3-152270a4de96 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Action: 'create', calling method: .version_select at 0x7fbc3871f790>, body: {"keypair": {"name": "tempest-keypair-1175488171"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:05.002760 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-c1e407fd-feb3-41d1-a6b3-152270a4de96 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Getting quotas for project 16870ad51e0f4d1d9d73d3922e34a632. Resources: {'key_pairs'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:52:05.007361 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-c1e407fd-feb3-41d1-a6b3-152270a4de96 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Getting quotas for user 008fc39c532a4a0ca8fc83e0d244a370 and project 16870ad51e0f4d1d9d73d3922e34a632. Resources: {'key_pairs'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:52:05.027076 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23cf98e8-d393-47aa-9cef-30bcc2d7a3e1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:05.027527 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23cf98e8-d393-47aa-9cef-30bcc2d7a3e1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:05.027990 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.objects.instance [None req-23cf98e8-d393-47aa-9cef-30bcc2d7a3e1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lazy-loading 'fault' on Instance uuid 06827ced-06c8-40dd-9ad3-3b5d02590d00 {{(pid=101271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:52:05.114419 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-23cf98e8-d393-47aa-9cef-30bcc2d7a3e1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:05.127807 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-c1e407fd-feb3-41d1-a6b3-152270a4de96 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Getting quotas for project 16870ad51e0f4d1d9d73d3922e34a632. Resources: {'key_pairs'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:52:05.132998 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-c1e407fd-feb3-41d1-a6b3-152270a4de96 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Getting quotas for user 008fc39c532a4a0ca8fc83e0d244a370 and project 16870ad51e0f4d1d9d73d3922e34a632. Resources: {'key_pairs'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:52:05.134027 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-23cf98e8-d393-47aa-9cef-30bcc2d7a3e1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 200 len: 1335 microversion: 2.1 time: 0.199763 Apr 08 02:52:05.134823 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 291/599] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:04 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 1335 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:05.149421 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c1e407fd-feb3-41d1-a6b3-152270a4de96 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.174808 Apr 08 02:52:05.150246 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 309/600] 10.222.0.23 () {60 vars in 1157 bytes} [Fri Apr 8 02:52:04 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:06.150338 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fb85a3ee-ba2e-4cf2-8d3a-ca2ca61fb451 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:06.150945 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-fb85a3ee-ba2e-4cf2-8d3a-ca2ca61fb451 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 06827ced-06c8-40dd-9ad3-3b5d02590d00] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:06.158136 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb85a3ee-ba2e-4cf2-8d3a-ca2ca61fb451 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:06.158582 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb85a3ee-ba2e-4cf2-8d3a-ca2ca61fb451 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:06.159350 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb85a3ee-ba2e-4cf2-8d3a-ca2ca61fb451 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:06.159775 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb85a3ee-ba2e-4cf2-8d3a-ca2ca61fb451 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:06.218519 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-fb85a3ee-ba2e-4cf2-8d3a-ca2ca61fb451 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] HTTP exception thrown: Instance 06827ced-06c8-40dd-9ad3-3b5d02590d00 could not be found. Apr 08 02:52:06.219131 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fb85a3ee-ba2e-4cf2-8d3a-ca2ca61fb451 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Returning 404 to user: Instance 06827ced-06c8-40dd-9ad3-3b5d02590d00 could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:52:06.219987 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-fb85a3ee-ba2e-4cf2-8d3a-ca2ca61fb451 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00" status: 404 len: 111 microversion: 2.1 time: 0.073349 Apr 08 02:52:06.220541 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 292/601] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:06 2022] GET /compute/v2.1/servers/06827ced-06c8-40dd-9ad3-3b5d02590d00 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:52:06.229122 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c1264c3e-3ea1-420e-a127-abf09b7a50a0 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '.version_select at 0x7fbc38098f70>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:06.251002 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c1264c3e-3ea1-420e-a127-abf09b7a50a0 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-429806259" status: 202 len: 0 microversion: 2.1 time: 0.025909 Apr 08 02:52:06.251775 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 310/602] 10.222.0.23 () {58 vars in 1217 bytes} [Fri Apr 8 02:52:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-429806259 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:52:06.942537 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-698b199b-54af-4b66-8643-7a29b4b031cf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2104462055", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5edff82e-54bb-4c43-8c44-0c613d4c1fa9"}], "security_groups": [{"name": "tempest-securitygroup--578963613"}], "key_name": "tempest-keypair-1175488171", "user_data": "}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:07.092207 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.network.neutron [None req-698b199b-54af-4b66-8643-7a29b4b031cf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] validate_networks() for [('5edff82e-54bb-4c43-8c44-0c613d4c1fa9', None, None, None)] {{(pid=101271) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:52:07.870459 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-698b199b-54af-4b66-8643-7a29b4b031cf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Flavor limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:52:07.871071 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-698b199b-54af-4b66-8643-7a29b4b031cf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Image limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:52:07.871346 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-698b199b-54af-4b66-8643-7a29b4b031cf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Flavor pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:52:07.871759 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-698b199b-54af-4b66-8643-7a29b4b031cf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Image pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:52:07.872226 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-698b199b-54af-4b66-8643-7a29b4b031cf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:52:07.880770 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-698b199b-54af-4b66-8643-7a29b4b031cf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:07.881212 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-698b199b-54af-4b66-8643-7a29b4b031cf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:07.882006 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-698b199b-54af-4b66-8643-7a29b4b031cf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:07.882435 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-698b199b-54af-4b66-8643-7a29b4b031cf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:07.899276 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-698b199b-54af-4b66-8643-7a29b4b031cf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Getting quotas for project 16870ad51e0f4d1d9d73d3922e34a632. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:52:07.903383 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-698b199b-54af-4b66-8643-7a29b4b031cf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Getting quotas for user 008fc39c532a4a0ca8fc83e0d244a370 and project 16870ad51e0f4d1d9d73d3922e34a632. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:52:07.914825 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-698b199b-54af-4b66-8643-7a29b4b031cf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Going to run 1 instances... {{(pid=101271) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:52:07.917364 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-698b199b-54af-4b66-8643-7a29b4b031cf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:52:07.961488 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-698b199b-54af-4b66-8643-7a29b4b031cf tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.023032 Apr 08 02:52:07.962125 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 293/603] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:52:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:52:07.971949 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b241f428-8679-4815-b30e-f5a499ec8e14 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:07.972677 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b241f428-8679-4815-b30e-f5a499ec8e14 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:08.058151 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b241f428-8679-4815-b30e-f5a499ec8e14 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:08.065782 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b241f428-8679-4815-b30e-f5a499ec8e14 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 200 len: 1238 microversion: 2.1 time: 0.097509 Apr 08 02:52:08.066382 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 311/604] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:07 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 1238 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:09.084870 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-82283725-84a9-4711-ae51-eb5d57ad6911 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:09.085689 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-82283725-84a9-4711-ae51-eb5d57ad6911 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:09.093830 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-82283725-84a9-4711-ae51-eb5d57ad6911 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:09.094375 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-82283725-84a9-4711-ae51-eb5d57ad6911 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:09.095142 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-82283725-84a9-4711-ae51-eb5d57ad6911 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:09.095575 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-82283725-84a9-4711-ae51-eb5d57ad6911 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:09.226869 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-82283725-84a9-4711-ae51-eb5d57ad6911 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:09.235007 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-82283725-84a9-4711-ae51-eb5d57ad6911 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 200 len: 1298 microversion: 2.1 time: 0.156071 Apr 08 02:52:09.235880 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 294/605] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:09 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 1298 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:09.846146 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-a247b0b0-e533-4076-b953-03ab86ceffb4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:09.846709 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-a247b0b0-e533-4076-b953-03ab86ceffb4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:09.855079 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a247b0b0-e533-4076-b953-03ab86ceffb4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:09.855602 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a247b0b0-e533-4076-b953-03ab86ceffb4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:09.856408 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a247b0b0-e533-4076-b953-03ab86ceffb4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:09.856900 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a247b0b0-e533-4076-b953-03ab86ceffb4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:09.919096 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-a247b0b0-e533-4076-b953-03ab86ceffb4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Going to try to terminate instance {{(pid=101272) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:52:10.042226 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-a247b0b0-e533-4076-b953-03ab86ceffb4 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "DELETE /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 204 len: 0 microversion: 2.1 time: 0.199252 Apr 08 02:52:10.042873 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 312/606] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:52:09 2022] DELETE /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:52:10.050583 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e3153ca1-416d-4327-8d19-dd172f9262c7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:10.051188 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e3153ca1-416d-4327-8d19-dd172f9262c7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:10.059265 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e3153ca1-416d-4327-8d19-dd172f9262c7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:10.059712 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e3153ca1-416d-4327-8d19-dd172f9262c7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:10.060520 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e3153ca1-416d-4327-8d19-dd172f9262c7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:10.060961 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e3153ca1-416d-4327-8d19-dd172f9262c7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:10.253718 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0fad379d-0d16-4e69-81aa-7f8fb3295da8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:10.254696 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0fad379d-0d16-4e69-81aa-7f8fb3295da8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:10.262740 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0fad379d-0d16-4e69-81aa-7f8fb3295da8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:10.262940 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0fad379d-0d16-4e69-81aa-7f8fb3295da8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:10.263881 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0fad379d-0d16-4e69-81aa-7f8fb3295da8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:10.264493 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0fad379d-0d16-4e69-81aa-7f8fb3295da8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:10.486110 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0fad379d-0d16-4e69-81aa-7f8fb3295da8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:10.496339 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0fad379d-0d16-4e69-81aa-7f8fb3295da8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 200 len: 1363 microversion: 2.1 time: 0.247348 Apr 08 02:52:10.497501 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 313/607] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:10 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:10.576906 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e3153ca1-416d-4327-8d19-dd172f9262c7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:10.586202 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e3153ca1-416d-4327-8d19-dd172f9262c7 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1507 microversion: 2.1 time: 0.539284 Apr 08 02:52:10.586778 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 295/608] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:10 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1507 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:11.183159 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-bb3217c2-0e5c-4d72-b73c-3f905d5e4c0d req-9a44f6d1-1853-4598-9564-1d04aeaeb3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8070c3-de05-4d72-a6c7-8ec58bd750c5", "tag": "2ccf4c17-cdc0-445d-8a18-659878ac2d69"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:11.185171 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:11.185171 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:52:11.195977 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-bb3217c2-0e5c-4d72-b73c-3f905d5e4c0d req-9a44f6d1-1853-4598-9564-1d04aeaeb3f8 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:11.196453 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-bb3217c2-0e5c-4d72-b73c-3f905d5e4c0d req-9a44f6d1-1853-4598-9564-1d04aeaeb3f8 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:11.224663 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-bb3217c2-0e5c-4d72-b73c-3f905d5e4c0d req-9a44f6d1-1853-4598-9564-1d04aeaeb3f8 service nova] Creating event network-changed:2ccf4c17-cdc0-445d-8a18-659878ac2d69 for instance dc8070c3-de05-4d72-a6c7-8ec58bd750c5 on hv-cinder-83705 Apr 08 02:52:11.229475 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-bb3217c2-0e5c-4d72-b73c-3f905d5e4c0d req-9a44f6d1-1853-4598-9564-1d04aeaeb3f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050939 Apr 08 02:52:11.230076 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 314/609] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:52:11.515010 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-eef97bef-265e-489a-96ab-415e36182fe8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:11.516048 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-eef97bef-265e-489a-96ab-415e36182fe8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:11.524166 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-eef97bef-265e-489a-96ab-415e36182fe8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:11.524738 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-eef97bef-265e-489a-96ab-415e36182fe8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:11.525941 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-eef97bef-265e-489a-96ab-415e36182fe8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:11.526608 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-eef97bef-265e-489a-96ab-415e36182fe8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:11.603884 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-41a37a7f-1dc8-4fc3-9e59-a3eb743f930e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:11.604609 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-41a37a7f-1dc8-4fc3-9e59-a3eb743f930e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:11.611972 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-41a37a7f-1dc8-4fc3-9e59-a3eb743f930e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:11.612420 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-41a37a7f-1dc8-4fc3-9e59-a3eb743f930e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:11.613180 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-41a37a7f-1dc8-4fc3-9e59-a3eb743f930e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:11.613628 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-41a37a7f-1dc8-4fc3-9e59-a3eb743f930e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:11.950174 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-eef97bef-265e-489a-96ab-415e36182fe8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:11.958479 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-eef97bef-265e-489a-96ab-415e36182fe8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 200 len: 1363 microversion: 2.1 time: 0.447541 Apr 08 02:52:11.959041 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 296/610] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:11 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 1363 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:12.001379 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-41a37a7f-1dc8-4fc3-9e59-a3eb743f930e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:12.011344 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-41a37a7f-1dc8-4fc3-9e59-a3eb743f930e tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 200 len: 1507 microversion: 2.1 time: 0.411390 Apr 08 02:52:12.012729 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 315/611] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:11 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 1507 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:52:12.104736 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-32da30be-74fc-4b97-b204-88de80789490 req-6b65608a-0706-477f-a34d-d66cebb1e784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71445bb3-86a1-47f4-a31d-f5d7fada20bd", "name": "network-vif-deleted", "tag": "d3a8eac8-aa70-41c5-92be-ee364676a64e"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:12.106674 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:12.106674 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:52:12.117718 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-32da30be-74fc-4b97-b204-88de80789490 req-6b65608a-0706-477f-a34d-d66cebb1e784 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:12.123297 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-32da30be-74fc-4b97-b204-88de80789490 req-6b65608a-0706-477f-a34d-d66cebb1e784 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:12.142391 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-32da30be-74fc-4b97-b204-88de80789490 req-6b65608a-0706-477f-a34d-d66cebb1e784 service nova] Creating event network-vif-deleted:d3a8eac8-aa70-41c5-92be-ee364676a64e for instance 71445bb3-86a1-47f4-a31d-f5d7fada20bd on hv-cinder-83705 Apr 08 02:52:12.148689 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-32da30be-74fc-4b97-b204-88de80789490 req-6b65608a-0706-477f-a34d-d66cebb1e784 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047453 Apr 08 02:52:12.149522 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 297/612] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:12.975257 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-30c57130-58cf-48c3-8d8e-1f196203b4dd tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:12.975872 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-30c57130-58cf-48c3-8d8e-1f196203b4dd tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:12.983074 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-30c57130-58cf-48c3-8d8e-1f196203b4dd tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:12.983526 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-30c57130-58cf-48c3-8d8e-1f196203b4dd tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:12.984324 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-30c57130-58cf-48c3-8d8e-1f196203b4dd tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:12.984769 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-30c57130-58cf-48c3-8d8e-1f196203b4dd tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:13.028926 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1636e564-6f6f-401d-b016-29ddf629606b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:13.029634 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1636e564-6f6f-401d-b016-29ddf629606b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 71445bb3-86a1-47f4-a31d-f5d7fada20bd] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:13.038101 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1636e564-6f6f-401d-b016-29ddf629606b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:13.038547 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1636e564-6f6f-401d-b016-29ddf629606b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:13.039309 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1636e564-6f6f-401d-b016-29ddf629606b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:13.039742 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1636e564-6f6f-401d-b016-29ddf629606b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:13.093713 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-1636e564-6f6f-401d-b016-29ddf629606b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] HTTP exception thrown: Instance 71445bb3-86a1-47f4-a31d-f5d7fada20bd could not be found. Apr 08 02:52:13.094309 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1636e564-6f6f-401d-b016-29ddf629606b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Returning 404 to user: Instance 71445bb3-86a1-47f4-a31d-f5d7fada20bd could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:52:13.095127 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1636e564-6f6f-401d-b016-29ddf629606b tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd" status: 404 len: 111 microversion: 2.1 time: 0.070380 Apr 08 02:52:13.095870 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 298/613] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:13 2022] GET /compute/v2.1/servers/71445bb3-86a1-47f4-a31d-f5d7fada20bd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:52:13.104288 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1f68d9a9-2246-4ecf-b6fc-27b3aa2ecc3c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:13.104790 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1f68d9a9-2246-4ecf-b6fc-27b3aa2ecc3c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:13.111767 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1f68d9a9-2246-4ecf-b6fc-27b3aa2ecc3c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:13.112250 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1f68d9a9-2246-4ecf-b6fc-27b3aa2ecc3c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:13.113011 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1f68d9a9-2246-4ecf-b6fc-27b3aa2ecc3c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:13.113454 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1f68d9a9-2246-4ecf-b6fc-27b3aa2ecc3c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:13.179026 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1f68d9a9-2246-4ecf-b6fc-27b3aa2ecc3c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Going to try to terminate instance {{(pid=101271) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:52:13.185240 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-30c57130-58cf-48c3-8d8e-1f196203b4dd tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:13.193802 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-30c57130-58cf-48c3-8d8e-1f196203b4dd tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 200 len: 1363 microversion: 2.1 time: 0.222265 Apr 08 02:52:13.194294 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 316/614] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:12 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:13.290678 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1f68d9a9-2246-4ecf-b6fc-27b3aa2ecc3c tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "DELETE /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 204 len: 0 microversion: 2.1 time: 0.189509 Apr 08 02:52:13.291202 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 299/615] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:52:13 2022] DELETE /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 02:52:13.299383 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-7fc8f63c-7a12-4529-847e-f55323c9b0f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:13.300070 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-7fc8f63c-7a12-4529-847e-f55323c9b0f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:13.307741 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7fc8f63c-7a12-4529-847e-f55323c9b0f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:13.308215 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7fc8f63c-7a12-4529-847e-f55323c9b0f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:13.308967 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7fc8f63c-7a12-4529-847e-f55323c9b0f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:13.309396 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7fc8f63c-7a12-4529-847e-f55323c9b0f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:13.529592 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-7fc8f63c-7a12-4529-847e-f55323c9b0f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:13.538798 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-7fc8f63c-7a12-4529-847e-f55323c9b0f1 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1522 microversion: 2.1 time: 0.243361 Apr 08 02:52:13.539388 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 317/616] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:13 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:14.211725 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f4b27f14-05f6-40fa-8e6d-cb041af960c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:14.212456 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f4b27f14-05f6-40fa-8e6d-cb041af960c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:14.219713 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f4b27f14-05f6-40fa-8e6d-cb041af960c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:14.220211 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f4b27f14-05f6-40fa-8e6d-cb041af960c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:14.220981 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f4b27f14-05f6-40fa-8e6d-cb041af960c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:14.221416 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f4b27f14-05f6-40fa-8e6d-cb041af960c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:14.538592 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f4b27f14-05f6-40fa-8e6d-cb041af960c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:14.546952 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f4b27f14-05f6-40fa-8e6d-cb041af960c7 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 200 len: 1363 microversion: 2.1 time: 0.339905 Apr 08 02:52:14.547524 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 300/617] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:14 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 1363 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:14.556453 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5c69e1e1-1d36-41df-8df0-664faf0b83bc tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:14.557578 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5c69e1e1-1d36-41df-8df0-664faf0b83bc tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:14.564690 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5c69e1e1-1d36-41df-8df0-664faf0b83bc tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:14.565134 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5c69e1e1-1d36-41df-8df0-664faf0b83bc tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:14.565888 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5c69e1e1-1d36-41df-8df0-664faf0b83bc tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:14.566315 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5c69e1e1-1d36-41df-8df0-664faf0b83bc tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:14.759164 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5c69e1e1-1d36-41df-8df0-664faf0b83bc tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cc30404a3c4a16aff55c90e698e489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:14.767299 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5c69e1e1-1d36-41df-8df0-664faf0b83bc tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 200 len: 1522 microversion: 2.1 time: 0.215353 Apr 08 02:52:14.767874 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 318/618] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:14 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:15.154341 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-5227ce1c-34c9-4af1-9fe7-9bd335faed87 req-f9fcfdb5-8114-4b32-85e9-13ba24e5776a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96569291-3f37-4b65-b902-9e31040c4328", "name": "network-vif-deleted", "tag": "2437d107-0e71-4cd9-bfef-38bb3ccc9385"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:15.156290 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:15.156290 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:52:15.166357 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-5227ce1c-34c9-4af1-9fe7-9bd335faed87 req-f9fcfdb5-8114-4b32-85e9-13ba24e5776a service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:15.167082 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-5227ce1c-34c9-4af1-9fe7-9bd335faed87 req-f9fcfdb5-8114-4b32-85e9-13ba24e5776a service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:15.184014 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-5227ce1c-34c9-4af1-9fe7-9bd335faed87 req-f9fcfdb5-8114-4b32-85e9-13ba24e5776a service nova] Creating event network-vif-deleted:2437d107-0e71-4cd9-bfef-38bb3ccc9385 for instance 96569291-3f37-4b65-b902-9e31040c4328 on hv-cinder-83705 Apr 08 02:52:15.188525 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-5227ce1c-34c9-4af1-9fe7-9bd335faed87 req-f9fcfdb5-8114-4b32-85e9-13ba24e5776a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037840 Apr 08 02:52:15.189107 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 301/619] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:15.563975 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-77ff6ff9-d0f2-4c7c-84c4-9a67a584ebf3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:15.564511 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-77ff6ff9-d0f2-4c7c-84c4-9a67a584ebf3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:15.572820 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-77ff6ff9-d0f2-4c7c-84c4-9a67a584ebf3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:15.573267 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-77ff6ff9-d0f2-4c7c-84c4-9a67a584ebf3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:15.574018 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-77ff6ff9-d0f2-4c7c-84c4-9a67a584ebf3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:15.574444 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-77ff6ff9-d0f2-4c7c-84c4-9a67a584ebf3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:15.780427 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-77ff6ff9-d0f2-4c7c-84c4-9a67a584ebf3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:15.787035 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-61e40bcf-32ff-46fa-a549-2813118d2302 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:15.788659 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-61e40bcf-32ff-46fa-a549-2813118d2302 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] [instance: 96569291-3f37-4b65-b902-9e31040c4328] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:15.789108 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-77ff6ff9-d0f2-4c7c-84c4-9a67a584ebf3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 200 len: 1363 microversion: 2.1 time: 0.228832 Apr 08 02:52:15.790209 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 319/620] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:15 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:15.796665 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-61e40bcf-32ff-46fa-a549-2813118d2302 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:15.797566 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-61e40bcf-32ff-46fa-a549-2813118d2302 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:15.798423 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-61e40bcf-32ff-46fa-a549-2813118d2302 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:15.798883 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-61e40bcf-32ff-46fa-a549-2813118d2302 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:15.853342 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-61e40bcf-32ff-46fa-a549-2813118d2302 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] HTTP exception thrown: Instance 96569291-3f37-4b65-b902-9e31040c4328 could not be found. Apr 08 02:52:15.854075 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-61e40bcf-32ff-46fa-a549-2813118d2302 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] Returning 404 to user: Instance 96569291-3f37-4b65-b902-9e31040c4328 could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:52:15.854905 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-61e40bcf-32ff-46fa-a549-2813118d2302 tempest-ServerRescueNegativeTestJSON-1115500795 tempest-ServerRescueNegativeTestJSON-1115500795-project] 10.222.0.23 "GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328" status: 404 len: 111 microversion: 2.1 time: 0.072375 Apr 08 02:52:15.855479 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 302/621] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:15 2022] GET /compute/v2.1/servers/96569291-3f37-4b65-b902-9e31040c4328 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:52:16.806601 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b8ed4868-a2f4-4311-b453-9e8496b48a13 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:16.807249 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b8ed4868-a2f4-4311-b453-9e8496b48a13 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:16.814384 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b8ed4868-a2f4-4311-b453-9e8496b48a13 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:16.814833 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b8ed4868-a2f4-4311-b453-9e8496b48a13 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:16.815601 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b8ed4868-a2f4-4311-b453-9e8496b48a13 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:16.816059 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b8ed4868-a2f4-4311-b453-9e8496b48a13 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:17.083223 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b8ed4868-a2f4-4311-b453-9e8496b48a13 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:17.091129 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b8ed4868-a2f4-4311-b453-9e8496b48a13 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 200 len: 1363 microversion: 2.1 time: 0.288556 Apr 08 02:52:17.091872 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 320/622] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:16 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:52:17.941568 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-e4e56d3f-e40b-4630-b75a-daa9980f31cb req-05e51a52-dd18-494e-ba31-039f05d2eee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8070c3-de05-4d72-a6c7-8ec58bd750c5", "name": "network-vif-plugged", "status": "completed", "tag": "2ccf4c17-cdc0-445d-8a18-659878ac2d69"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:17.943167 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:17.943167 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:52:17.951616 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-e4e56d3f-e40b-4630-b75a-daa9980f31cb req-05e51a52-dd18-494e-ba31-039f05d2eee5 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:17.952106 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-e4e56d3f-e40b-4630-b75a-daa9980f31cb req-05e51a52-dd18-494e-ba31-039f05d2eee5 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:17.968758 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-e4e56d3f-e40b-4630-b75a-daa9980f31cb req-05e51a52-dd18-494e-ba31-039f05d2eee5 service nova] Creating event network-vif-plugged:2ccf4c17-cdc0-445d-8a18-659878ac2d69 for instance dc8070c3-de05-4d72-a6c7-8ec58bd750c5 on hv-cinder-83705 Apr 08 02:52:17.974071 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-e4e56d3f-e40b-4630-b75a-daa9980f31cb req-05e51a52-dd18-494e-ba31-039f05d2eee5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036090 Apr 08 02:52:17.974871 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 303/623] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:18.107391 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ff4fad3a-0dc3-477a-b523-eb766614aa8f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:18.108028 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ff4fad3a-0dc3-477a-b523-eb766614aa8f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:18.116540 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ff4fad3a-0dc3-477a-b523-eb766614aa8f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:18.117299 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ff4fad3a-0dc3-477a-b523-eb766614aa8f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:18.118277 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ff4fad3a-0dc3-477a-b523-eb766614aa8f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:18.118914 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ff4fad3a-0dc3-477a-b523-eb766614aa8f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:18.458977 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ff4fad3a-0dc3-477a-b523-eb766614aa8f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:18.467492 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ff4fad3a-0dc3-477a-b523-eb766614aa8f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 200 len: 1363 microversion: 2.1 time: 0.363700 Apr 08 02:52:18.468416 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 321/624] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:18 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:19.484567 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-466c27e7-4122-4c9e-92cd-e8b4056fc6e3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:19.485468 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-466c27e7-4122-4c9e-92cd-e8b4056fc6e3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:19.492928 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-466c27e7-4122-4c9e-92cd-e8b4056fc6e3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:19.493375 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-466c27e7-4122-4c9e-92cd-e8b4056fc6e3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:19.494144 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-466c27e7-4122-4c9e-92cd-e8b4056fc6e3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:19.494577 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-466c27e7-4122-4c9e-92cd-e8b4056fc6e3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:20.009354 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-466c27e7-4122-4c9e-92cd-e8b4056fc6e3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:20.022958 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-466c27e7-4122-4c9e-92cd-e8b4056fc6e3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 200 len: 1363 microversion: 2.1 time: 0.542443 Apr 08 02:52:20.024159 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 304/625] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:19 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 1363 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:21.039135 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5e3aecf1-594e-41c2-89d9-94903b5e0a8e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:21.039877 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5e3aecf1-594e-41c2-89d9-94903b5e0a8e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:21.047401 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5e3aecf1-594e-41c2-89d9-94903b5e0a8e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:21.047844 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5e3aecf1-594e-41c2-89d9-94903b5e0a8e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:21.048701 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5e3aecf1-594e-41c2-89d9-94903b5e0a8e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:21.049138 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5e3aecf1-594e-41c2-89d9-94903b5e0a8e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:21.262524 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5e3aecf1-594e-41c2-89d9-94903b5e0a8e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:52:21.271058 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5e3aecf1-594e-41c2-89d9-94903b5e0a8e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 200 len: 1548 microversion: 2.1 time: 0.235799 Apr 08 02:52:21.271627 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 322/626] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:21 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 1548 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:21.287959 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d16e29de-7fca-4941-9fc5-1fc4244456d8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:21.288467 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-d16e29de-7fca-4941-9fc5-1fc4244456d8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:21.295673 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d16e29de-7fca-4941-9fc5-1fc4244456d8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:21.296164 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d16e29de-7fca-4941-9fc5-1fc4244456d8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:21.296938 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d16e29de-7fca-4941-9fc5-1fc4244456d8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:21.297375 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d16e29de-7fca-4941-9fc5-1fc4244456d8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:21.485485 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-d16e29de-7fca-4941-9fc5-1fc4244456d8 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.201776 Apr 08 02:52:21.486071 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 305/627] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Apr 8 02:52:21 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-interface => generated 284 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:23.081053 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-72cf5238-7fb5-4760-9528-938680ef59c7 req-8cf57bb4-cb36-42fe-a410-8da2f428cfb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8070c3-de05-4d72-a6c7-8ec58bd750c5", "tag": "2ccf4c17-cdc0-445d-8a18-659878ac2d69"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:23.084266 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:23.084266 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:52:23.094291 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-72cf5238-7fb5-4760-9528-938680ef59c7 req-8cf57bb4-cb36-42fe-a410-8da2f428cfb0 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:23.095004 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-72cf5238-7fb5-4760-9528-938680ef59c7 req-8cf57bb4-cb36-42fe-a410-8da2f428cfb0 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:23.110978 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-72cf5238-7fb5-4760-9528-938680ef59c7 req-8cf57bb4-cb36-42fe-a410-8da2f428cfb0 service nova] Creating event network-changed:2ccf4c17-cdc0-445d-8a18-659878ac2d69 for instance dc8070c3-de05-4d72-a6c7-8ec58bd750c5 on hv-cinder-83705 Apr 08 02:52:23.116366 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-72cf5238-7fb5-4760-9528-938680ef59c7 req-8cf57bb4-cb36-42fe-a410-8da2f428cfb0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039410 Apr 08 02:52:23.117148 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 323/628] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:24.187662 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-57ccdb0d-6a06-40c3-8eb7-0088bda35b07 tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] Calling method '.version_select at 0x7fbc3848cf70>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:24.272217 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-57ccdb0d-6a06-40c3-8eb7-0088bda35b07 tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/5438d24a-b71d-40ac-a893-d4043b57b9aa" status: 200 len: 350 microversion: 2.1 time: 0.088157 Apr 08 02:52:24.272781 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 306/629] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Apr 8 02:52:24 2022] GET /compute/v2.1/os-volumes/5438d24a-b71d-40ac-a893-d4043b57b9aa => generated 350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:25.756839 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-63653d27-8154-4e95-99f6-b5246fba748f tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] Calling method '.version_select at 0x7fbc38098c10>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:25.835075 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-63653d27-8154-4e95-99f6-b5246fba748f tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/062811f7-f675-4310-8651-381823d64344" status: 200 len: 351 microversion: 2.1 time: 0.082988 Apr 08 02:52:25.835631 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 324/630] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Apr 8 02:52:25 2022] GET /compute/v2.1/os-volumes/062811f7-f675-4310-8651-381823d64344 => generated 351 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:27.287614 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2a26cb28-7369-463a-8ebe-49e1be54fe1c tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] Calling method '.version_select at 0x7fbc3828f430>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:27.367690 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2a26cb28-7369-463a-8ebe-49e1be54fe1c tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/75831dd7-04c5-42fc-baa7-bf25c85005b8" status: 200 len: 351 microversion: 2.1 time: 0.083812 Apr 08 02:52:27.368283 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 307/631] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Apr 8 02:52:27 2022] GET /compute/v2.1/os-volumes/75831dd7-04c5-42fc-baa7-bf25c85005b8 => generated 351 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:27.379745 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3036669f-24b2-4250-af27-daeba2b07681 tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] Calling method '.version_select at 0x7fbc38098430>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:27.458754 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3036669f-24b2-4250-af27-daeba2b07681 tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083129 Apr 08 02:52:27.459306 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 325/632] 10.222.0.23 () {58 vars in 1133 bytes} [Fri Apr 8 02:52:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:27.471304 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-320824d7-a0b6-41e4-9d61-035a0260fd08 tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] Calling method '.version_select at 0x7fbc38606310>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:27.552563 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-320824d7-a0b6-41e4-9d61-035a0260fd08 tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084767 Apr 08 02:52:27.553123 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 308/633] 10.222.0.23 () {58 vars in 1148 bytes} [Fri Apr 8 02:52:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:27.564690 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-361ed1bc-ba61-4eab-a582-523fe154908c tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] Calling method '.version_select at 0x7fbc3849ff70>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:27.644315 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-361ed1bc-ba61-4eab-a582-523fe154908c tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083144 Apr 08 02:52:27.645251 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 326/634] 10.222.0.23 () {58 vars in 1133 bytes} [Fri Apr 8 02:52:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:27.655776 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f0dce4c0-25da-4a1d-b0b7-ef397abf2cf7 tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] Calling method '.version_select at 0x7fbc381c0700>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:27.737613 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f0dce4c0-25da-4a1d-b0b7-ef397abf2cf7 tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085328 Apr 08 02:52:27.738195 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 309/635] 10.222.0.23 () {58 vars in 1166 bytes} [Fri Apr 8 02:52:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:27.750154 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c3b070f8-acec-474a-916f-ba24b4229d75 tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] Calling method '.version_select at 0x7fbc3849f670>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:27.830119 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c3b070f8-acec-474a-916f-ba24b4229d75 tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.083587 Apr 08 02:52:27.830680 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 327/636] 10.222.0.23 () {58 vars in 1169 bytes} [Fri Apr 8 02:52:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:27.842294 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-3f686f6f-2961-4785-9a7f-dacabcb0281c tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] Calling method '.version_select at 0x7fbc3828fa60>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:27.920708 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-3f686f6f-2961-4785-9a7f-dacabcb0281c tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.081963 Apr 08 02:52:27.921262 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 310/637] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Apr 8 02:52:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:27.933476 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1f719861-f4fc-49bd-a0d3-6445e39a2d3e tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] Calling method '.version_select at 0x7fbc3971eb80>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:28.013187 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1f719861-f4fc-49bd-a0d3-6445e39a2d3e tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083470 Apr 08 02:52:28.013748 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 328/638] 10.222.0.23 () {58 vars in 1187 bytes} [Fri Apr 8 02:52:27 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:28.024825 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8e108626-9494-42e8-9d39-3fc9a065aff2 tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] Calling method '.version_select at 0x7fbc38606ca0>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:28.103587 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8e108626-9494-42e8-9d39-3fc9a065aff2 tempest-VolumesTestJSON-1867512293 tempest-VolumesTestJSON-1867512293-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.082262 Apr 08 02:52:28.104180 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 311/639] 10.222.0.23 () {58 vars in 1154 bytes} [Fri Apr 8 02:52:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:59.046344 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2182ab15-0900-4500-8213-64aed1caa3c3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:59.046952 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2182ab15-0900-4500-8213-64aed1caa3c3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:52:59.057533 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2182ab15-0900-4500-8213-64aed1caa3c3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:59.057987 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2182ab15-0900-4500-8213-64aed1caa3c3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:59.058746 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2182ab15-0900-4500-8213-64aed1caa3c3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:59.059179 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2182ab15-0900-4500-8213-64aed1caa3c3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:59.114667 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2182ab15-0900-4500-8213-64aed1caa3c3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66/ips" status: 200 len: 151 microversion: 2.20 time: 0.072275 Apr 08 02:52:59.115228 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 329/640] 10.222.0.23 () {60 vars in 1288 bytes} [Fri Apr 8 02:52:59 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66/ips => generated 151 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:53:01.019595 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e4d5fc08-ecc7-44d0-8530-9a72f3edc802] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 08 02:53:01.023971 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-6dfa1f3e-554a-4543-a0a6-af2f09bf5c6a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:01.024532 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-6dfa1f3e-554a-4543-a0a6-af2f09bf5c6a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:01.031803 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6dfa1f3e-554a-4543-a0a6-af2f09bf5c6a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:01.032286 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6dfa1f3e-554a-4543-a0a6-af2f09bf5c6a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:01.033041 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6dfa1f3e-554a-4543-a0a6-af2f09bf5c6a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:01.033472 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6dfa1f3e-554a-4543-a0a6-af2f09bf5c6a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:01.091025 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.objects.instance [None req-6dfa1f3e-554a-4543-a0a6-af2f09bf5c6a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lazy-loading 'flavor' on Instance uuid 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 {{(pid=101271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:53:01.422244 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-6dfa1f3e-554a-4543-a0a6-af2f09bf5c6a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "POST /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66/action" status: 202 len: 0 microversion: 2.20 time: 0.403864 Apr 08 02:53:01.422857 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 312/641] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Apr 8 02:53:01 2022] POST /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:53:01.431142 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-20c62043-c395-4a5b-b2a7-1dcfa42d7b79 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:01.431788 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-20c62043-c395-4a5b-b2a7-1dcfa42d7b79 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:01.439110 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-20c62043-c395-4a5b-b2a7-1dcfa42d7b79 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:01.439547 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-20c62043-c395-4a5b-b2a7-1dcfa42d7b79 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:01.440512 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-20c62043-c395-4a5b-b2a7-1dcfa42d7b79 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:01.440947 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-20c62043-c395-4a5b-b2a7-1dcfa42d7b79 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:01.638234 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-20c62043-c395-4a5b-b2a7-1dcfa42d7b79 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:01.646778 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-20c62043-c395-4a5b-b2a7-1dcfa42d7b79 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:01.648304 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-20c62043-c395-4a5b-b2a7-1dcfa42d7b79 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:01.649422 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-20c62043-c395-4a5b-b2a7-1dcfa42d7b79 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.222414 Apr 08 02:53:01.649969 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 330/642] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:01 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:53:02.671023 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-825b7afe-397a-44ac-b794-ea28e2e64a54 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:02.671718 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-825b7afe-397a-44ac-b794-ea28e2e64a54 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:02.681716 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO oslo.messaging._drivers.impl_rabbit [-] [e4d5fc08-ecc7-44d0-8530-9a72f3edc802] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 59938. Apr 08 02:53:02.685369 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-825b7afe-397a-44ac-b794-ea28e2e64a54 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:02.685816 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-825b7afe-397a-44ac-b794-ea28e2e64a54 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:02.686578 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-825b7afe-397a-44ac-b794-ea28e2e64a54 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:02.687012 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-825b7afe-397a-44ac-b794-ea28e2e64a54 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:02.886207 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-825b7afe-397a-44ac-b794-ea28e2e64a54 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:02.894758 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-825b7afe-397a-44ac-b794-ea28e2e64a54 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:02.896266 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-825b7afe-397a-44ac-b794-ea28e2e64a54 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:02.898628 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-825b7afe-397a-44ac-b794-ea28e2e64a54 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.233303 Apr 08 02:53:02.899196 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 313/643] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:02 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:03.917869 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f7e4d8f5-a02d-4822-a0ba-fc3c49dcdba7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:03.918509 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f7e4d8f5-a02d-4822-a0ba-fc3c49dcdba7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:03.925788 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f7e4d8f5-a02d-4822-a0ba-fc3c49dcdba7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:03.926234 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f7e4d8f5-a02d-4822-a0ba-fc3c49dcdba7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:03.926989 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f7e4d8f5-a02d-4822-a0ba-fc3c49dcdba7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:03.927423 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f7e4d8f5-a02d-4822-a0ba-fc3c49dcdba7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:04.119437 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f7e4d8f5-a02d-4822-a0ba-fc3c49dcdba7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:04.128065 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f7e4d8f5-a02d-4822-a0ba-fc3c49dcdba7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:04.129566 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f7e4d8f5-a02d-4822-a0ba-fc3c49dcdba7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:04.130692 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f7e4d8f5-a02d-4822-a0ba-fc3c49dcdba7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.217449 Apr 08 02:53:04.131233 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 331/644] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:03 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:05.150199 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f5e7cf23-0e4a-4599-a634-fe542e08b414 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:05.150862 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f5e7cf23-0e4a-4599-a634-fe542e08b414 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:05.158619 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f5e7cf23-0e4a-4599-a634-fe542e08b414 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:05.159058 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f5e7cf23-0e4a-4599-a634-fe542e08b414 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:05.159810 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f5e7cf23-0e4a-4599-a634-fe542e08b414 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:05.160268 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f5e7cf23-0e4a-4599-a634-fe542e08b414 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:05.355338 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f5e7cf23-0e4a-4599-a634-fe542e08b414 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:05.364069 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f5e7cf23-0e4a-4599-a634-fe542e08b414 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:05.365587 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f5e7cf23-0e4a-4599-a634-fe542e08b414 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:05.366988 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f5e7cf23-0e4a-4599-a634-fe542e08b414 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.220618 Apr 08 02:53:05.367404 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 314/645] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:05 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:06.385307 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b0267c0b-7b9b-4f06-9229-acf8c2459b1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:06.385944 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b0267c0b-7b9b-4f06-9229-acf8c2459b1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:06.393058 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b0267c0b-7b9b-4f06-9229-acf8c2459b1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:06.393510 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b0267c0b-7b9b-4f06-9229-acf8c2459b1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:06.394268 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b0267c0b-7b9b-4f06-9229-acf8c2459b1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:06.394703 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b0267c0b-7b9b-4f06-9229-acf8c2459b1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:06.599086 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b0267c0b-7b9b-4f06-9229-acf8c2459b1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:06.608426 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b0267c0b-7b9b-4f06-9229-acf8c2459b1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:06.610102 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b0267c0b-7b9b-4f06-9229-acf8c2459b1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:06.611305 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b0267c0b-7b9b-4f06-9229-acf8c2459b1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.229929 Apr 08 02:53:06.612149 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 332/646] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:06 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:07.630475 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ba14ef83-5819-4c24-b591-bc54e98ce494 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:07.631087 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ba14ef83-5819-4c24-b591-bc54e98ce494 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:07.639070 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ba14ef83-5819-4c24-b591-bc54e98ce494 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:07.639523 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ba14ef83-5819-4c24-b591-bc54e98ce494 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:07.640313 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ba14ef83-5819-4c24-b591-bc54e98ce494 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:07.640751 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ba14ef83-5819-4c24-b591-bc54e98ce494 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:07.833577 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ba14ef83-5819-4c24-b591-bc54e98ce494 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:07.843035 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ba14ef83-5819-4c24-b591-bc54e98ce494 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:07.844554 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ba14ef83-5819-4c24-b591-bc54e98ce494 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:07.845672 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ba14ef83-5819-4c24-b591-bc54e98ce494 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.218951 Apr 08 02:53:07.846213 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 315/647] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:07 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:08.864414 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ce0b17da-524a-49e3-be58-a5059e1d9e5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:08.865026 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ce0b17da-524a-49e3-be58-a5059e1d9e5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:08.872975 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce0b17da-524a-49e3-be58-a5059e1d9e5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:08.873432 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce0b17da-524a-49e3-be58-a5059e1d9e5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:08.874201 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce0b17da-524a-49e3-be58-a5059e1d9e5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:08.874642 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce0b17da-524a-49e3-be58-a5059e1d9e5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:09.068059 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ce0b17da-524a-49e3-be58-a5059e1d9e5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:09.076637 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ce0b17da-524a-49e3-be58-a5059e1d9e5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:09.078149 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ce0b17da-524a-49e3-be58-a5059e1d9e5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:09.079279 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ce0b17da-524a-49e3-be58-a5059e1d9e5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.218637 Apr 08 02:53:09.079831 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 333/648] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:08 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:10.097734 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-98ad124f-7062-4ae1-9eec-00684c96b99f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:10.098337 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-98ad124f-7062-4ae1-9eec-00684c96b99f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:10.106568 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-98ad124f-7062-4ae1-9eec-00684c96b99f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:10.107009 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-98ad124f-7062-4ae1-9eec-00684c96b99f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:10.107763 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-98ad124f-7062-4ae1-9eec-00684c96b99f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:10.108225 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-98ad124f-7062-4ae1-9eec-00684c96b99f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:10.308745 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-98ad124f-7062-4ae1-9eec-00684c96b99f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:10.317232 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-98ad124f-7062-4ae1-9eec-00684c96b99f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:10.318711 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-98ad124f-7062-4ae1-9eec-00684c96b99f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:10.320315 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-98ad124f-7062-4ae1-9eec-00684c96b99f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.226266 Apr 08 02:53:10.320868 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 316/649] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:10 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:11.339974 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-427f665d-028e-4eb6-8cee-8715c03fa422 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:11.340592 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-427f665d-028e-4eb6-8cee-8715c03fa422 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:11.347814 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-427f665d-028e-4eb6-8cee-8715c03fa422 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:11.348297 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-427f665d-028e-4eb6-8cee-8715c03fa422 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:11.349058 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-427f665d-028e-4eb6-8cee-8715c03fa422 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:11.349495 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-427f665d-028e-4eb6-8cee-8715c03fa422 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:11.542156 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-427f665d-028e-4eb6-8cee-8715c03fa422 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:11.550776 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-427f665d-028e-4eb6-8cee-8715c03fa422 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:11.552298 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-427f665d-028e-4eb6-8cee-8715c03fa422 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:11.553465 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-427f665d-028e-4eb6-8cee-8715c03fa422 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.217279 Apr 08 02:53:11.554168 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 334/650] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:11 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:12.572318 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2e3d86a3-ab02-420a-8c6f-459a4fab689e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:12.572915 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2e3d86a3-ab02-420a-8c6f-459a4fab689e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:12.580535 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2e3d86a3-ab02-420a-8c6f-459a4fab689e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:12.580982 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2e3d86a3-ab02-420a-8c6f-459a4fab689e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:12.581775 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2e3d86a3-ab02-420a-8c6f-459a4fab689e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:12.582205 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2e3d86a3-ab02-420a-8c6f-459a4fab689e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:12.780203 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2e3d86a3-ab02-420a-8c6f-459a4fab689e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:12.788823 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2e3d86a3-ab02-420a-8c6f-459a4fab689e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:12.790336 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2e3d86a3-ab02-420a-8c6f-459a4fab689e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:12.791463 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2e3d86a3-ab02-420a-8c6f-459a4fab689e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.223423 Apr 08 02:53:12.792090 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 317/651] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:12 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:13.810972 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e9f69fda-5356-4dc4-9022-a21731e2f4d7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:13.811532 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e9f69fda-5356-4dc4-9022-a21731e2f4d7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:13.818806 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e9f69fda-5356-4dc4-9022-a21731e2f4d7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:13.820092 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e9f69fda-5356-4dc4-9022-a21731e2f4d7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:13.820859 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e9f69fda-5356-4dc4-9022-a21731e2f4d7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:13.821294 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e9f69fda-5356-4dc4-9022-a21731e2f4d7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:14.015601 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e9f69fda-5356-4dc4-9022-a21731e2f4d7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:14.025274 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e9f69fda-5356-4dc4-9022-a21731e2f4d7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:14.026774 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e9f69fda-5356-4dc4-9022-a21731e2f4d7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:14.027910 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e9f69fda-5356-4dc4-9022-a21731e2f4d7 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.220798 Apr 08 02:53:14.028472 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 335/652] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:13 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:15.046871 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-3a0f3115-85ad-4e31-bed1-9899179de7f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:15.047412 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-3a0f3115-85ad-4e31-bed1-9899179de7f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:15.054751 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3a0f3115-85ad-4e31-bed1-9899179de7f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:15.055211 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3a0f3115-85ad-4e31-bed1-9899179de7f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:15.056262 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3a0f3115-85ad-4e31-bed1-9899179de7f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:15.056705 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3a0f3115-85ad-4e31-bed1-9899179de7f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:15.269792 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3a0f3115-85ad-4e31-bed1-9899179de7f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:15.278965 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3a0f3115-85ad-4e31-bed1-9899179de7f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:15.280497 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3a0f3115-85ad-4e31-bed1-9899179de7f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:15.281652 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-3a0f3115-85ad-4e31-bed1-9899179de7f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.239284 Apr 08 02:53:15.282220 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 318/653] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:15 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:16.300760 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b14f1356-c2ca-4710-bd9b-7700881d7030 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:16.301370 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b14f1356-c2ca-4710-bd9b-7700881d7030 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:16.309993 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b14f1356-c2ca-4710-bd9b-7700881d7030 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:16.310383 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b14f1356-c2ca-4710-bd9b-7700881d7030 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:16.311149 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b14f1356-c2ca-4710-bd9b-7700881d7030 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:16.311588 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b14f1356-c2ca-4710-bd9b-7700881d7030 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:16.505638 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b14f1356-c2ca-4710-bd9b-7700881d7030 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:16.514772 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b14f1356-c2ca-4710-bd9b-7700881d7030 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:16.516307 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b14f1356-c2ca-4710-bd9b-7700881d7030 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:16.517438 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b14f1356-c2ca-4710-bd9b-7700881d7030 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.220698 Apr 08 02:53:16.517993 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 336/654] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:16 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:17.535889 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fd26b14a-1af8-4463-a070-9965e294e164 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:17.536538 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-fd26b14a-1af8-4463-a070-9965e294e164 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:17.544309 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fd26b14a-1af8-4463-a070-9965e294e164 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:17.544754 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fd26b14a-1af8-4463-a070-9965e294e164 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:17.545518 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fd26b14a-1af8-4463-a070-9965e294e164 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:17.545947 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fd26b14a-1af8-4463-a070-9965e294e164 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:17.741923 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fd26b14a-1af8-4463-a070-9965e294e164 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:17.750953 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fd26b14a-1af8-4463-a070-9965e294e164 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:17.752575 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fd26b14a-1af8-4463-a070-9965e294e164 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:17.753604 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-fd26b14a-1af8-4463-a070-9965e294e164 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.221499 Apr 08 02:53:17.754154 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 319/655] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:17 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:18.774346 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-41a4a155-9df1-4329-b010-a6cdf787af6d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:18.774994 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-41a4a155-9df1-4329-b010-a6cdf787af6d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:18.782390 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-41a4a155-9df1-4329-b010-a6cdf787af6d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:18.782839 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-41a4a155-9df1-4329-b010-a6cdf787af6d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:18.783656 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-41a4a155-9df1-4329-b010-a6cdf787af6d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:18.784092 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-41a4a155-9df1-4329-b010-a6cdf787af6d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:18.992831 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-41a4a155-9df1-4329-b010-a6cdf787af6d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:19.001631 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-41a4a155-9df1-4329-b010-a6cdf787af6d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:19.003111 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-41a4a155-9df1-4329-b010-a6cdf787af6d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:19.004244 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-41a4a155-9df1-4329-b010-a6cdf787af6d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.234939 Apr 08 02:53:19.004785 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 337/656] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:18 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:20.024570 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-40660b93-d02d-437b-9ad2-0e8190193d9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:20.025176 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-40660b93-d02d-437b-9ad2-0e8190193d9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:20.032330 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-40660b93-d02d-437b-9ad2-0e8190193d9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:20.032785 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-40660b93-d02d-437b-9ad2-0e8190193d9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:20.033550 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-40660b93-d02d-437b-9ad2-0e8190193d9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:20.033986 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-40660b93-d02d-437b-9ad2-0e8190193d9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:20.243232 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-40660b93-d02d-437b-9ad2-0e8190193d9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:20.251827 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-40660b93-d02d-437b-9ad2-0e8190193d9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:20.253340 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-40660b93-d02d-437b-9ad2-0e8190193d9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:20.254465 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-40660b93-d02d-437b-9ad2-0e8190193d9e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.234309 Apr 08 02:53:20.255010 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 320/657] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:20 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:21.273485 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c7404aca-61ff-44ad-bab4-6b0afb32e218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:21.274050 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c7404aca-61ff-44ad-bab4-6b0afb32e218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:21.281731 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c7404aca-61ff-44ad-bab4-6b0afb32e218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:21.282182 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c7404aca-61ff-44ad-bab4-6b0afb32e218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:21.282945 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c7404aca-61ff-44ad-bab4-6b0afb32e218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:21.283383 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c7404aca-61ff-44ad-bab4-6b0afb32e218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:21.476000 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c7404aca-61ff-44ad-bab4-6b0afb32e218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:21.485080 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c7404aca-61ff-44ad-bab4-6b0afb32e218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:21.486796 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c7404aca-61ff-44ad-bab4-6b0afb32e218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:21.488132 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c7404aca-61ff-44ad-bab4-6b0afb32e218 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1744 microversion: 2.20 time: 0.218962 Apr 08 02:53:21.495723 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 338/658] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:21 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:53:22.510173 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1a6e9adb-df0e-433a-9945-aef5a58ddad2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:22.511403 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1a6e9adb-df0e-433a-9945-aef5a58ddad2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:22.518842 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1a6e9adb-df0e-433a-9945-aef5a58ddad2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:22.519492 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1a6e9adb-df0e-433a-9945-aef5a58ddad2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:22.520304 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1a6e9adb-df0e-433a-9945-aef5a58ddad2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:22.520906 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1a6e9adb-df0e-433a-9945-aef5a58ddad2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:22.723385 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1a6e9adb-df0e-433a-9945-aef5a58ddad2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:22.732807 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1a6e9adb-df0e-433a-9945-aef5a58ddad2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:22.734317 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1a6e9adb-df0e-433a-9945-aef5a58ddad2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:22.735448 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1a6e9adb-df0e-433a-9945-aef5a58ddad2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1744 microversion: 2.20 time: 0.230331 Apr 08 02:53:22.736012 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 321/659] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:22 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1744 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:23.404614 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-bafa3b70-6bb7-4408-915f-5c5d95b1f2bc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:23.405158 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-bafa3b70-6bb7-4408-915f-5c5d95b1f2bc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:23.412354 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bafa3b70-6bb7-4408-915f-5c5d95b1f2bc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:23.413490 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bafa3b70-6bb7-4408-915f-5c5d95b1f2bc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:23.414426 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bafa3b70-6bb7-4408-915f-5c5d95b1f2bc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:23.414870 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bafa3b70-6bb7-4408-915f-5c5d95b1f2bc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:23.472091 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-bafa3b70-6bb7-4408-915f-5c5d95b1f2bc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944/ips" status: 200 len: 149 microversion: 2.1 time: 0.071082 Apr 08 02:53:23.472656 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 339/660] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Apr 8 02:53:23 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944/ips => generated 149 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:53:23.758606 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5938738d-3f9e-4783-b5f7-c8d1bed09214 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:23.759535 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-5938738d-3f9e-4783-b5f7-c8d1bed09214 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:23.766764 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5938738d-3f9e-4783-b5f7-c8d1bed09214 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:23.767224 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5938738d-3f9e-4783-b5f7-c8d1bed09214 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:23.768269 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5938738d-3f9e-4783-b5f7-c8d1bed09214 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:23.768705 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5938738d-3f9e-4783-b5f7-c8d1bed09214 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:23.970870 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5938738d-3f9e-4783-b5f7-c8d1bed09214 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:23.979590 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5938738d-3f9e-4783-b5f7-c8d1bed09214 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:23.981138 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5938738d-3f9e-4783-b5f7-c8d1bed09214 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:23.982265 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-5938738d-3f9e-4783-b5f7-c8d1bed09214 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1744 microversion: 2.20 time: 0.228522 Apr 08 02:53:23.982814 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 322/661] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:23 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1744 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:24.219124 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-e3e44360-73f8-4329-8975-704600794126 req-37d83089-1557-4eb1-80f4-1152915bd14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66", "name": "network-vif-plugged", "status": "completed", "tag": "b1b47b52-100c-4e18-8a4a-3d16d8561d14"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:24.220933 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:53:24.220933 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:53:24.229787 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-e3e44360-73f8-4329-8975-704600794126 req-37d83089-1557-4eb1-80f4-1152915bd14e service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:24.230234 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-e3e44360-73f8-4329-8975-704600794126 req-37d83089-1557-4eb1-80f4-1152915bd14e service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:24.246177 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-e3e44360-73f8-4329-8975-704600794126 req-37d83089-1557-4eb1-80f4-1152915bd14e service nova] Creating event network-vif-plugged:b1b47b52-100c-4e18-8a4a-3d16d8561d14 for instance 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 on hv-cinder-83705 Apr 08 02:53:24.251132 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-e3e44360-73f8-4329-8975-704600794126 req-37d83089-1557-4eb1-80f4-1152915bd14e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035725 Apr 08 02:53:24.251724 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 340/662] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:53:25.002337 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-3bcff7f1-be90-4267-9545-ad7c3380d9dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:25.002943 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-3bcff7f1-be90-4267-9545-ad7c3380d9dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:25.010359 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3bcff7f1-be90-4267-9545-ad7c3380d9dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:25.010803 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3bcff7f1-be90-4267-9545-ad7c3380d9dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:25.011558 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3bcff7f1-be90-4267-9545-ad7c3380d9dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:25.012013 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3bcff7f1-be90-4267-9545-ad7c3380d9dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:25.215999 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3bcff7f1-be90-4267-9545-ad7c3380d9dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:25.224493 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3bcff7f1-be90-4267-9545-ad7c3380d9dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:25.226004 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3bcff7f1-be90-4267-9545-ad7c3380d9dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:25.227125 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-3bcff7f1-be90-4267-9545-ad7c3380d9dc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1744 microversion: 2.20 time: 0.228724 Apr 08 02:53:25.227680 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 323/663] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:24 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1744 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:26.002874 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-cdee962a-9cbb-42b2-b2dd-575236101bc1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9d8745a-8540-4fbd-8ff0-d6119f8f8710"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:26.004026 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-cdee962a-9cbb-42b2-b2dd-575236101bc1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:26.011886 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cdee962a-9cbb-42b2-b2dd-575236101bc1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:26.012356 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cdee962a-9cbb-42b2-b2dd-575236101bc1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:26.013108 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cdee962a-9cbb-42b2-b2dd-575236101bc1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:26.013537 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cdee962a-9cbb-42b2-b2dd-575236101bc1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:26.248144 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-66d64809-50e8-4190-91e5-5b61c980b0ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:26.248932 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-66d64809-50e8-4190-91e5-5b61c980b0ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:26.257361 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-66d64809-50e8-4190-91e5-5b61c980b0ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:26.257816 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-66d64809-50e8-4190-91e5-5b61c980b0ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:26.258591 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-66d64809-50e8-4190-91e5-5b61c980b0ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:26.259122 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-66d64809-50e8-4190-91e5-5b61c980b0ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:26.412145 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-cdee962a-9cbb-42b2-b2dd-575236101bc1 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "POST /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412983 Apr 08 02:53:26.413046 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 341/664] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Apr 8 02:53:25 2022] POST /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:53:26.588242 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-66d64809-50e8-4190-91e5-5b61c980b0ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:26.599173 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-66d64809-50e8-4190-91e5-5b61c980b0ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:26.601252 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-66d64809-50e8-4190-91e5-5b61c980b0ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:26.602381 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-66d64809-50e8-4190-91e5-5b61c980b0ab tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1739 microversion: 2.20 time: 0.359405 Apr 08 02:53:26.602942 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 324/665] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:26 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1739 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:53:27.622770 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e344202e-9d5a-4156-bdb3-a6307fff54ee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:27.624175 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e344202e-9d5a-4156-bdb3-a6307fff54ee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:27.636396 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e344202e-9d5a-4156-bdb3-a6307fff54ee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:27.636849 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e344202e-9d5a-4156-bdb3-a6307fff54ee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:27.637865 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e344202e-9d5a-4156-bdb3-a6307fff54ee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:27.638300 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e344202e-9d5a-4156-bdb3-a6307fff54ee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:27.843227 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e344202e-9d5a-4156-bdb3-a6307fff54ee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:27.852124 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e344202e-9d5a-4156-bdb3-a6307fff54ee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:27.853854 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e344202e-9d5a-4156-bdb3-a6307fff54ee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:27.855165 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e344202e-9d5a-4156-bdb3-a6307fff54ee tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1739 microversion: 2.20 time: 0.237226 Apr 08 02:53:27.855709 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 342/666] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:27 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:28.877162 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b904a035-a896-473d-b875-70c5fc6dc5be tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:28.878291 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b904a035-a896-473d-b875-70c5fc6dc5be tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:28.889702 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b904a035-a896-473d-b875-70c5fc6dc5be tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:28.890156 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b904a035-a896-473d-b875-70c5fc6dc5be tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:28.890936 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b904a035-a896-473d-b875-70c5fc6dc5be tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:28.891371 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b904a035-a896-473d-b875-70c5fc6dc5be tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:29.116231 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b904a035-a896-473d-b875-70c5fc6dc5be tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:29.126090 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b904a035-a896-473d-b875-70c5fc6dc5be tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:29.128140 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b904a035-a896-473d-b875-70c5fc6dc5be tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:29.129442 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b904a035-a896-473d-b875-70c5fc6dc5be tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1739 microversion: 2.20 time: 0.260159 Apr 08 02:53:29.130389 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 325/667] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:28 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:30.150233 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-43874946-e602-4bdc-a096-2941cb002413 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:30.152586 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-43874946-e602-4bdc-a096-2941cb002413 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:30.161006 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-43874946-e602-4bdc-a096-2941cb002413 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:30.161771 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-43874946-e602-4bdc-a096-2941cb002413 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:30.163874 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-43874946-e602-4bdc-a096-2941cb002413 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:30.164523 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-43874946-e602-4bdc-a096-2941cb002413 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:30.399049 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-43874946-e602-4bdc-a096-2941cb002413 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:30.408756 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-43874946-e602-4bdc-a096-2941cb002413 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:30.410251 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-43874946-e602-4bdc-a096-2941cb002413 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:30.411374 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-43874946-e602-4bdc-a096-2941cb002413 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1739 microversion: 2.20 time: 0.265871 Apr 08 02:53:30.412209 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 343/668] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:30 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:31.430547 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5fbbf0ca-dd78-4ffe-9d6c-a158851465e9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:31.431556 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-5fbbf0ca-dd78-4ffe-9d6c-a158851465e9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:31.438736 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5fbbf0ca-dd78-4ffe-9d6c-a158851465e9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:31.439195 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5fbbf0ca-dd78-4ffe-9d6c-a158851465e9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:31.440195 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5fbbf0ca-dd78-4ffe-9d6c-a158851465e9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:31.440671 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5fbbf0ca-dd78-4ffe-9d6c-a158851465e9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:31.652134 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5fbbf0ca-dd78-4ffe-9d6c-a158851465e9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:31.661167 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5fbbf0ca-dd78-4ffe-9d6c-a158851465e9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:31.663412 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5fbbf0ca-dd78-4ffe-9d6c-a158851465e9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:31.664585 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-5fbbf0ca-dd78-4ffe-9d6c-a158851465e9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1739 microversion: 2.20 time: 0.237776 Apr 08 02:53:31.666220 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 326/669] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:31 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:32.690991 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c5576e44-7601-4675-97f8-a222b91db433 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:32.698440 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c5576e44-7601-4675-97f8-a222b91db433 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:32.706402 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c5576e44-7601-4675-97f8-a222b91db433 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:32.706853 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c5576e44-7601-4675-97f8-a222b91db433 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:32.707633 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c5576e44-7601-4675-97f8-a222b91db433 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:32.708098 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c5576e44-7601-4675-97f8-a222b91db433 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:32.928962 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c5576e44-7601-4675-97f8-a222b91db433 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:32.938186 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c5576e44-7601-4675-97f8-a222b91db433 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:32.939685 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c5576e44-7601-4675-97f8-a222b91db433 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:32.941244 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c5576e44-7601-4675-97f8-a222b91db433 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1739 microversion: 2.20 time: 0.254261 Apr 08 02:53:32.941994 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 344/670] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:32 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:33.960772 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-6e17cc74-1fd4-439f-9611-575dff3c2315 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:33.961376 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-6e17cc74-1fd4-439f-9611-575dff3c2315 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:33.969513 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6e17cc74-1fd4-439f-9611-575dff3c2315 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:33.969957 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6e17cc74-1fd4-439f-9611-575dff3c2315 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:33.970782 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6e17cc74-1fd4-439f-9611-575dff3c2315 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:33.971537 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6e17cc74-1fd4-439f-9611-575dff3c2315 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:34.216155 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-6e17cc74-1fd4-439f-9611-575dff3c2315 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:34.227052 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-6e17cc74-1fd4-439f-9611-575dff3c2315 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:34.229009 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-6e17cc74-1fd4-439f-9611-575dff3c2315 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:34.230389 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-6e17cc74-1fd4-439f-9611-575dff3c2315 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1739 microversion: 2.20 time: 0.274097 Apr 08 02:53:34.231485 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 327/671] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:33 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:34.294251 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-8dfe3d53-daf9-4ebb-a14d-14b617f33ba7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9d8745a-8540-4fbd-8ff0-d6119f8f8710"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:34.296622 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-8dfe3d53-daf9-4ebb-a14d-14b617f33ba7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:34.306603 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8dfe3d53-daf9-4ebb-a14d-14b617f33ba7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:34.307267 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8dfe3d53-daf9-4ebb-a14d-14b617f33ba7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:34.308146 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8dfe3d53-daf9-4ebb-a14d-14b617f33ba7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:34.308586 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8dfe3d53-daf9-4ebb-a14d-14b617f33ba7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:34.479272 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-8dfe3d53-daf9-4ebb-a14d-14b617f33ba7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] HTTP exception thrown: Invalid volume: volume b9d8745a-8540-4fbd-8ff0-d6119f8f8710 is already attached to instances: d509168a-9e7c-4ff6-b331-343f649a2944 Apr 08 02:53:34.480018 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-8dfe3d53-daf9-4ebb-a14d-14b617f33ba7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Returning 400 to user: Invalid volume: volume b9d8745a-8540-4fbd-8ff0-d6119f8f8710 is already attached to instances: d509168a-9e7c-4ff6-b331-343f649a2944 {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:53:34.481301 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-8dfe3d53-daf9-4ebb-a14d-14b617f33ba7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "POST /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.190816 Apr 08 02:53:34.485479 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 345/672] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Apr 8 02:53:34 2022] POST /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944/os-volume_attachments => generated 174 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 02:53:34.577519 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-77ba70c6-092e-4615-a007-10118abf1296 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:34.578141 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-77ba70c6-092e-4615-a007-10118abf1296 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:34.586702 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-77ba70c6-092e-4615-a007-10118abf1296 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:34.587375 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-77ba70c6-092e-4615-a007-10118abf1296 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:34.588248 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-77ba70c6-092e-4615-a007-10118abf1296 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:34.588750 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-77ba70c6-092e-4615-a007-10118abf1296 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:34.749352 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.objects.instance [None req-77ba70c6-092e-4615-a007-10118abf1296 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lazy-loading 'services' on Instance uuid d509168a-9e7c-4ff6-b331-343f649a2944 {{(pid=101271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:53:34.897748 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-77ba70c6-092e-4615-a007-10118abf1296 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944/os-volume_attachments/b9d8745a-8540-4fbd-8ff0-d6119f8f8710" status: 202 len: 0 microversion: 2.1 time: 0.323224 Apr 08 02:53:34.906904 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 328/673] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Apr 8 02:53:34 2022] DELETE /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944/os-volume_attachments/b9d8745a-8540-4fbd-8ff0-d6119f8f8710 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:53:34.916288 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-18eb5ea9-9996-4550-8244-244388968ea5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:34.917373 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-18eb5ea9-9996-4550-8244-244388968ea5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:34.925728 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-18eb5ea9-9996-4550-8244-244388968ea5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:34.926183 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-18eb5ea9-9996-4550-8244-244388968ea5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:34.926947 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-18eb5ea9-9996-4550-8244-244388968ea5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:34.927397 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-18eb5ea9-9996-4550-8244-244388968ea5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:35.004667 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-18eb5ea9-9996-4550-8244-244388968ea5 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088818 Apr 08 02:53:35.004667 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 346/674] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:53:34 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:53:35.251073 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2b1f6bb0-76f3-4b23-ab66-4f81c4968e41 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:35.252301 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2b1f6bb0-76f3-4b23-ab66-4f81c4968e41 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:35.261150 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2b1f6bb0-76f3-4b23-ab66-4f81c4968e41 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:35.261599 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2b1f6bb0-76f3-4b23-ab66-4f81c4968e41 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:35.262368 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2b1f6bb0-76f3-4b23-ab66-4f81c4968e41 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:35.262803 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2b1f6bb0-76f3-4b23-ab66-4f81c4968e41 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:35.485678 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2b1f6bb0-76f3-4b23-ab66-4f81c4968e41 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:35.495267 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2b1f6bb0-76f3-4b23-ab66-4f81c4968e41 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:35.496713 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2b1f6bb0-76f3-4b23-ab66-4f81c4968e41 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:35.498174 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2b1f6bb0-76f3-4b23-ab66-4f81c4968e41 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1739 microversion: 2.20 time: 0.251838 Apr 08 02:53:35.498930 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 329/675] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:35 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:36.013224 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-91d380d9-1a95-4cf2-98de-5a5a174b34e7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:36.014954 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-91d380d9-1a95-4cf2-98de-5a5a174b34e7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:36.027831 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-91d380d9-1a95-4cf2-98de-5a5a174b34e7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:36.028477 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-91d380d9-1a95-4cf2-98de-5a5a174b34e7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:36.030366 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-91d380d9-1a95-4cf2-98de-5a5a174b34e7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:36.031074 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-91d380d9-1a95-4cf2-98de-5a5a174b34e7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:36.138178 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-91d380d9-1a95-4cf2-98de-5a5a174b34e7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128715 Apr 08 02:53:36.139222 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 347/676] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:53:36 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:53:36.517493 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-0a280979-e5d6-4038-aa29-23f45c7c3f1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:36.518200 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-0a280979-e5d6-4038-aa29-23f45c7c3f1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:36.532456 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0a280979-e5d6-4038-aa29-23f45c7c3f1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:36.532920 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0a280979-e5d6-4038-aa29-23f45c7c3f1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:36.533719 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0a280979-e5d6-4038-aa29-23f45c7c3f1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:36.534161 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0a280979-e5d6-4038-aa29-23f45c7c3f1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:36.896129 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0a280979-e5d6-4038-aa29-23f45c7c3f1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:36.905719 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0a280979-e5d6-4038-aa29-23f45c7c3f1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:36.907235 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0a280979-e5d6-4038-aa29-23f45c7c3f1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:36.908405 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-0a280979-e5d6-4038-aa29-23f45c7c3f1d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1739 microversion: 2.20 time: 0.394702 Apr 08 02:53:36.919781 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 330/677] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:36 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1739 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:37.151070 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ace3948c-3373-451b-a99c-ee1ad18449ac tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:37.151946 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ace3948c-3373-451b-a99c-ee1ad18449ac tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:37.159413 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ace3948c-3373-451b-a99c-ee1ad18449ac tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:37.159865 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ace3948c-3373-451b-a99c-ee1ad18449ac tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:37.160743 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ace3948c-3373-451b-a99c-ee1ad18449ac tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:37.161179 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ace3948c-3373-451b-a99c-ee1ad18449ac tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:37.242830 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ace3948c-3373-451b-a99c-ee1ad18449ac tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096735 Apr 08 02:53:37.243837 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 348/678] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:53:37 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:53:37.344758 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-9ef3ff0b-7960-432a-885e-05f5dac7f2f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:37.346181 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-9ef3ff0b-7960-432a-885e-05f5dac7f2f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:37.354677 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9ef3ff0b-7960-432a-885e-05f5dac7f2f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:37.355130 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9ef3ff0b-7960-432a-885e-05f5dac7f2f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:37.356802 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9ef3ff0b-7960-432a-885e-05f5dac7f2f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:37.357257 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9ef3ff0b-7960-432a-885e-05f5dac7f2f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:37.419946 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-9ef3ff0b-7960-432a-885e-05f5dac7f2f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Going to try to terminate instance {{(pid=101271) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:53:37.540432 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-9ef3ff0b-7960-432a-885e-05f5dac7f2f9 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 204 len: 0 microversion: 2.1 time: 0.199032 Apr 08 02:53:37.541270 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 331/679] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:53:37 2022] DELETE /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:53:37.549717 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b0867ee9-ec04-4b29-b9d1-31b66ad9c012 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:37.550427 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b0867ee9-ec04-4b29-b9d1-31b66ad9c012 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:37.557961 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b0867ee9-ec04-4b29-b9d1-31b66ad9c012 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:37.558406 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b0867ee9-ec04-4b29-b9d1-31b66ad9c012 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:37.559166 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b0867ee9-ec04-4b29-b9d1-31b66ad9c012 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:37.559596 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b0867ee9-ec04-4b29-b9d1-31b66ad9c012 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:37.752334 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b0867ee9-ec04-4b29-b9d1-31b66ad9c012 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:37.760465 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b0867ee9-ec04-4b29-b9d1-31b66ad9c012 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1680 microversion: 2.1 time: 0.214645 Apr 08 02:53:37.761013 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 349/680] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:37 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:37.928319 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a522e343-f6fe-441d-bcb7-06d0cd7729a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:37.929017 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a522e343-f6fe-441d-bcb7-06d0cd7729a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:37.936463 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a522e343-f6fe-441d-bcb7-06d0cd7729a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:37.936910 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a522e343-f6fe-441d-bcb7-06d0cd7729a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:37.937677 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a522e343-f6fe-441d-bcb7-06d0cd7729a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:37.938114 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a522e343-f6fe-441d-bcb7-06d0cd7729a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:38.131468 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a522e343-f6fe-441d-bcb7-06d0cd7729a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:38.140048 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a522e343-f6fe-441d-bcb7-06d0cd7729a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:38.141547 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a522e343-f6fe-441d-bcb7-06d0cd7729a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:38.142680 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a522e343-f6fe-441d-bcb7-06d0cd7729a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1739 microversion: 2.20 time: 0.218883 Apr 08 02:53:38.143215 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 332/681] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:37 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:38.777801 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0615aa88-6312-42d9-b7e0-d6fd818561cc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:38.778537 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0615aa88-6312-42d9-b7e0-d6fd818561cc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:38.785675 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0615aa88-6312-42d9-b7e0-d6fd818561cc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:38.786098 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0615aa88-6312-42d9-b7e0-d6fd818561cc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:38.786852 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0615aa88-6312-42d9-b7e0-d6fd818561cc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:38.788287 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0615aa88-6312-42d9-b7e0-d6fd818561cc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:38.981480 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0615aa88-6312-42d9-b7e0-d6fd818561cc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:38.989826 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0615aa88-6312-42d9-b7e0-d6fd818561cc tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1680 microversion: 2.1 time: 0.215733 Apr 08 02:53:38.991143 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 350/682] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:38 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:39.161440 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-72a46860-2d44-4d79-bfd6-718428d08997 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:39.162609 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-72a46860-2d44-4d79-bfd6-718428d08997 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:39.169896 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-72a46860-2d44-4d79-bfd6-718428d08997 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:39.170352 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-72a46860-2d44-4d79-bfd6-718428d08997 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:39.171121 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-72a46860-2d44-4d79-bfd6-718428d08997 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:39.171557 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-72a46860-2d44-4d79-bfd6-718428d08997 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:39.362827 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-72a46860-2d44-4d79-bfd6-718428d08997 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:39.371762 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-72a46860-2d44-4d79-bfd6-718428d08997 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:39.373281 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-72a46860-2d44-4d79-bfd6-718428d08997 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:39.374387 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-72a46860-2d44-4d79-bfd6-718428d08997 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1721 microversion: 2.20 time: 0.216752 Apr 08 02:53:39.374935 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 333/683] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:39 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:40.007194 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-55e44472-73f5-43d8-9b94-492827bf717d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:40.007898 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-55e44472-73f5-43d8-9b94-492827bf717d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:40.015443 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-55e44472-73f5-43d8-9b94-492827bf717d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:40.015892 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-55e44472-73f5-43d8-9b94-492827bf717d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:40.016712 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-55e44472-73f5-43d8-9b94-492827bf717d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:40.017141 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-55e44472-73f5-43d8-9b94-492827bf717d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:40.216039 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-55e44472-73f5-43d8-9b94-492827bf717d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:40.224302 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-55e44472-73f5-43d8-9b94-492827bf717d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1680 microversion: 2.1 time: 0.221510 Apr 08 02:53:40.225939 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 351/684] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:40 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1680 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:40.393500 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-9ede773d-edff-4088-a7ea-974f794aeb8e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:40.394245 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-9ede773d-edff-4088-a7ea-974f794aeb8e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:40.402308 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9ede773d-edff-4088-a7ea-974f794aeb8e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:40.402755 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9ede773d-edff-4088-a7ea-974f794aeb8e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:40.403520 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9ede773d-edff-4088-a7ea-974f794aeb8e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:40.404044 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9ede773d-edff-4088-a7ea-974f794aeb8e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:40.844464 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-9ede773d-edff-4088-a7ea-974f794aeb8e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:40.854189 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-9ede773d-edff-4088-a7ea-974f794aeb8e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:40.855700 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-9ede773d-edff-4088-a7ea-974f794aeb8e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:40.856899 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-9ede773d-edff-4088-a7ea-974f794aeb8e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1721 microversion: 2.20 time: 0.467131 Apr 08 02:53:40.857459 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 334/685] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:40 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1721 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:41.243021 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-24aca0a2-ad31-4a7c-9a0c-053a04076594 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:41.244025 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-24aca0a2-ad31-4a7c-9a0c-053a04076594 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:41.251863 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-24aca0a2-ad31-4a7c-9a0c-053a04076594 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:41.252434 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-24aca0a2-ad31-4a7c-9a0c-053a04076594 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:41.253301 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-24aca0a2-ad31-4a7c-9a0c-053a04076594 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:41.253815 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-24aca0a2-ad31-4a7c-9a0c-053a04076594 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:41.372767 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-24aca0a2-ad31-4a7c-9a0c-053a04076594 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:41.382086 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-24aca0a2-ad31-4a7c-9a0c-053a04076594 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 200 len: 1613 microversion: 2.1 time: 0.143503 Apr 08 02:53:41.391896 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 352/686] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:41 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 1613 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:41.397805 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-eac680fb-992c-46fa-a850-faad961dcf84 req-927ddc19-021c-43d8-9ebe-21dbd7a6ff5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d509168a-9e7c-4ff6-b331-343f649a2944", "name": "network-vif-deleted", "tag": "15ea6272-ea85-47cf-ad3d-80473f241c2d"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:41.399708 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:53:41.399708 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:53:41.409123 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-eac680fb-992c-46fa-a850-faad961dcf84 req-927ddc19-021c-43d8-9ebe-21dbd7a6ff5c service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:41.410348 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-eac680fb-992c-46fa-a850-faad961dcf84 req-927ddc19-021c-43d8-9ebe-21dbd7a6ff5c service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:41.432330 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-eac680fb-992c-46fa-a850-faad961dcf84 req-927ddc19-021c-43d8-9ebe-21dbd7a6ff5c service nova] Creating event network-vif-deleted:15ea6272-ea85-47cf-ad3d-80473f241c2d for instance d509168a-9e7c-4ff6-b331-343f649a2944 on hv-cinder-83705 Apr 08 02:53:41.437109 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-eac680fb-992c-46fa-a850-faad961dcf84 req-927ddc19-021c-43d8-9ebe-21dbd7a6ff5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051449 Apr 08 02:53:41.437808 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 335/687] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:53:41.876046 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-6cb00fc8-409f-43d3-bf67-9386332644e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:41.876688 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-6cb00fc8-409f-43d3-bf67-9386332644e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:41.884396 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6cb00fc8-409f-43d3-bf67-9386332644e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:41.884844 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6cb00fc8-409f-43d3-bf67-9386332644e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:41.885613 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6cb00fc8-409f-43d3-bf67-9386332644e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:41.887044 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6cb00fc8-409f-43d3-bf67-9386332644e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:42.088910 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-6cb00fc8-409f-43d3-bf67-9386332644e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:42.100829 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-6cb00fc8-409f-43d3-bf67-9386332644e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:42.103132 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-6cb00fc8-409f-43d3-bf67-9386332644e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:42.104911 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-6cb00fc8-409f-43d3-bf67-9386332644e5 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1664 microversion: 2.20 time: 0.232530 Apr 08 02:53:42.106403 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 353/688] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:41 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1664 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:42.124748 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d98f5b23-c494-46b0-9b76-030cf220a12f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9859a739-2964-48d9-94a9-2e64117720c8"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:42.126217 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-d98f5b23-c494-46b0-9b76-030cf220a12f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:42.137243 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d98f5b23-c494-46b0-9b76-030cf220a12f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:42.138051 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d98f5b23-c494-46b0-9b76-030cf220a12f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:42.139022 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d98f5b23-c494-46b0-9b76-030cf220a12f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:42.139670 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d98f5b23-c494-46b0-9b76-030cf220a12f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:42.230572 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-0d84c0e1-7087-4185-895a-e0c9f9b9715e req-c6fe6fe8-230b-4dfc-ab10-4e5c0a6755fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66", "name": "network-vif-unplugged", "status": "completed", "tag": "b1b47b52-100c-4e18-8a4a-3d16d8561d14"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:42.232523 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:53:42.232523 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:53:42.252350 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-0d84c0e1-7087-4185-895a-e0c9f9b9715e req-c6fe6fe8-230b-4dfc-ab10-4e5c0a6755fe service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:42.253007 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-0d84c0e1-7087-4185-895a-e0c9f9b9715e req-c6fe6fe8-230b-4dfc-ab10-4e5c0a6755fe service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:42.269558 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.compute.server_external_events [req-0d84c0e1-7087-4185-895a-e0c9f9b9715e req-c6fe6fe8-230b-4dfc-ab10-4e5c0a6755fe service nova] Unable to find a host for instance 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66. Dropping event network-vif-unplugged {{(pid=101272) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Apr 08 02:53:42.270557 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-0d84c0e1-7087-4185-895a-e0c9f9b9715e req-c6fe6fe8-230b-4dfc-ab10-4e5c0a6755fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044213 Apr 08 02:53:42.272934 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 354/689] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 08 02:53:42.400368 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3bcd6f20-3228-43ed-b083-49d6b005a1a6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:42.401191 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-3bcd6f20-3228-43ed-b083-49d6b005a1a6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:42.410281 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3bcd6f20-3228-43ed-b083-49d6b005a1a6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:42.410681 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3bcd6f20-3228-43ed-b083-49d6b005a1a6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:42.411451 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3bcd6f20-3228-43ed-b083-49d6b005a1a6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:42.412475 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3bcd6f20-3228-43ed-b083-49d6b005a1a6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:42.470250 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-3bcd6f20-3228-43ed-b083-49d6b005a1a6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] HTTP exception thrown: Instance d509168a-9e7c-4ff6-b331-343f649a2944 could not be found. Apr 08 02:53:42.470854 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3bcd6f20-3228-43ed-b083-49d6b005a1a6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Returning 404 to user: Instance d509168a-9e7c-4ff6-b331-343f649a2944 could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:53:42.471766 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3bcd6f20-3228-43ed-b083-49d6b005a1a6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 404 len: 111 microversion: 2.1 time: 0.075578 Apr 08 02:53:42.472563 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 355/690] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:42 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:53:42.482544 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-7a6f72a5-f18a-4a5f-804e-a7b7015cbff7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '.version_select at 0x7fbc3871f0d0>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:42.505360 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-7a6f72a5-f18a-4a5f-804e-a7b7015cbff7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203071489" status: 202 len: 0 microversion: 2.1 time: 0.027052 Apr 08 02:53:42.506323 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 356/691] 10.222.0.23 () {58 vars in 1220 bytes} [Fri Apr 8 02:53:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203071489 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:53:42.627790 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-d98f5b23-c494-46b0-9b76-030cf220a12f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "POST /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.507728 Apr 08 02:53:42.633104 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 336/692] 10.222.0.23 () {62 vars in 1363 bytes} [Fri Apr 8 02:53:42 2022] POST /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66/os-volume_attachments => generated 188 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:53:42.825459 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-8c0cd5e2-f9ce-4d1e-87e2-cc1f17a8e092 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:42.826221 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-8c0cd5e2-f9ce-4d1e-87e2-cc1f17a8e092 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:42.833604 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8c0cd5e2-f9ce-4d1e-87e2-cc1f17a8e092 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:42.834491 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8c0cd5e2-f9ce-4d1e-87e2-cc1f17a8e092 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:42.835378 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8c0cd5e2-f9ce-4d1e-87e2-cc1f17a8e092 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:42.835917 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8c0cd5e2-f9ce-4d1e-87e2-cc1f17a8e092 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:43.214740 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-8c0cd5e2-f9ce-4d1e-87e2-cc1f17a8e092 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "DELETE /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66/os-volume_attachments/9859a739-2964-48d9-94a9-2e64117720c8" status: 202 len: 0 microversion: 2.20 time: 0.393864 Apr 08 02:53:43.218335 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 357/693] 10.222.0.23 () {60 vars in 1456 bytes} [Fri Apr 8 02:53:42 2022] DELETE /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66/os-volume_attachments/9859a739-2964-48d9-94a9-2e64117720c8 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:53:43.302527 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-07d10645-aaac-4c52-bb0f-0d733b9f46a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:43.303647 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-07d10645-aaac-4c52-bb0f-0d733b9f46a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:43.312215 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-07d10645-aaac-4c52-bb0f-0d733b9f46a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:43.312668 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-07d10645-aaac-4c52-bb0f-0d733b9f46a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:43.313439 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-07d10645-aaac-4c52-bb0f-0d733b9f46a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:43.313878 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-07d10645-aaac-4c52-bb0f-0d733b9f46a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:43.465707 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-07d10645-aaac-4c52-bb0f-0d733b9f46a2 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "POST /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66/action" status: 202 len: 0 microversion: 2.20 time: 0.166934 Apr 08 02:53:43.469195 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 337/694] 10.222.0.23 () {62 vars in 1318 bytes} [Fri Apr 8 02:53:43 2022] POST /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 08 02:53:43.475249 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-451c332e-6503-4ac5-b3ee-0a3398e34dd0 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:43.476129 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-451c332e-6503-4ac5-b3ee-0a3398e34dd0 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:43.493649 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-451c332e-6503-4ac5-b3ee-0a3398e34dd0 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:43.494103 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-451c332e-6503-4ac5-b3ee-0a3398e34dd0 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:43.494897 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-451c332e-6503-4ac5-b3ee-0a3398e34dd0 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:43.495335 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-451c332e-6503-4ac5-b3ee-0a3398e34dd0 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:43.631310 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-328569f6-6bae-423a-a8b4-f836ad39e0ff tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Action: 'create', calling method: .version_select at 0x7fbc38757550>, body: {"keypair": {"name": "tempest-keypair-1423644043"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:43.657427 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-328569f6-6bae-423a-a8b4-f836ad39e0ff tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:53:43.661368 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-328569f6-6bae-423a-a8b4-f836ad39e0ff tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for user 44a64fb1ebd9411eb6156c8ef97c3072 and project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:53:43.775506 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-451c332e-6503-4ac5-b3ee-0a3398e34dd0 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:43.784805 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-451c332e-6503-4ac5-b3ee-0a3398e34dd0 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:43.786546 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-451c332e-6503-4ac5-b3ee-0a3398e34dd0 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:43.789144 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-451c332e-6503-4ac5-b3ee-0a3398e34dd0 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1672 microversion: 2.20 time: 0.318403 Apr 08 02:53:43.790014 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 358/695] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:43 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1672 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:43.802762 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-328569f6-6bae-423a-a8b4-f836ad39e0ff tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:53:43.806884 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-328569f6-6bae-423a-a8b4-f836ad39e0ff tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for user 44a64fb1ebd9411eb6156c8ef97c3072 and project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:53:43.820187 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-328569f6-6bae-423a-a8b4-f836ad39e0ff tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.193060 Apr 08 02:53:43.821074 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 338/696] 10.222.0.23 () {60 vars in 1157 bytes} [Fri Apr 8 02:53:43 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:44.807869 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1103e48b-3597-4b83-ad0a-afb0339a855a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:44.808515 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1103e48b-3597-4b83-ad0a-afb0339a855a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:44.815850 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1103e48b-3597-4b83-ad0a-afb0339a855a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:44.816343 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1103e48b-3597-4b83-ad0a-afb0339a855a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:44.817105 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1103e48b-3597-4b83-ad0a-afb0339a855a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:44.817536 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1103e48b-3597-4b83-ad0a-afb0339a855a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:45.216697 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1103e48b-3597-4b83-ad0a-afb0339a855a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:45.226204 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1103e48b-3597-4b83-ad0a-afb0339a855a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:45.227987 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1103e48b-3597-4b83-ad0a-afb0339a855a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:45.229427 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1103e48b-3597-4b83-ad0a-afb0339a855a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.425674 Apr 08 02:53:45.230092 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 359/697] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:44 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:45.738668 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c58313c5-2263-496b-bc70-40945704bdde tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-79604945", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43b1983b-07c7-47cb-8ae4-f6d4398035b6"}], "security_groups": [{"name": "tempest-securitygroup--339958649"}], "key_name": "tempest-keypair-1423644043", "user_data": "}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:45.880204 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.network.neutron [None req-c58313c5-2263-496b-bc70-40945704bdde tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] validate_networks() for [('43b1983b-07c7-47cb-8ae4-f6d4398035b6', None, None, None)] {{(pid=101271) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:53:46.250424 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-40a98bdb-6317-41bb-8d2c-5516fe0ddb61 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:46.251149 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-40a98bdb-6317-41bb-8d2c-5516fe0ddb61 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:46.259887 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-40a98bdb-6317-41bb-8d2c-5516fe0ddb61 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:46.260667 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-40a98bdb-6317-41bb-8d2c-5516fe0ddb61 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:46.265080 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-40a98bdb-6317-41bb-8d2c-5516fe0ddb61 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:46.265746 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-40a98bdb-6317-41bb-8d2c-5516fe0ddb61 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:46.549342 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-40a98bdb-6317-41bb-8d2c-5516fe0ddb61 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:46.560968 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-40a98bdb-6317-41bb-8d2c-5516fe0ddb61 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:46.563469 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-40a98bdb-6317-41bb-8d2c-5516fe0ddb61 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:46.564870 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-40a98bdb-6317-41bb-8d2c-5516fe0ddb61 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.318768 Apr 08 02:53:46.565909 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 360/698] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:46 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:46.600367 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-c58313c5-2263-496b-bc70-40945704bdde tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Flavor limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:53:46.601344 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-c58313c5-2263-496b-bc70-40945704bdde tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Image limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:53:46.602137 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-c58313c5-2263-496b-bc70-40945704bdde tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Flavor pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:53:46.603139 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-c58313c5-2263-496b-bc70-40945704bdde tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Image pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:53:46.603719 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-c58313c5-2263-496b-bc70-40945704bdde tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:53:46.614550 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c58313c5-2263-496b-bc70-40945704bdde tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:46.615323 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c58313c5-2263-496b-bc70-40945704bdde tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:46.616759 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c58313c5-2263-496b-bc70-40945704bdde tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:46.617359 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c58313c5-2263-496b-bc70-40945704bdde tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:46.638457 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-c58313c5-2263-496b-bc70-40945704bdde tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:53:46.642863 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-c58313c5-2263-496b-bc70-40945704bdde tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Getting quotas for user 44a64fb1ebd9411eb6156c8ef97c3072 and project ee869d0592334c418ed6cf2b4ba04ace. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:53:46.655433 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c58313c5-2263-496b-bc70-40945704bdde tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Going to run 1 instances... {{(pid=101271) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:53:46.657807 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c58313c5-2263-496b-bc70-40945704bdde tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:53:46.706320 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c58313c5-2263-496b-bc70-40945704bdde tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.971630 Apr 08 02:53:46.706924 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 339/699] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:53:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 02:53:46.718843 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-8d339af1-8a95-4020-a918-a03f073a6aa2 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:46.719727 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-8d339af1-8a95-4020-a918-a03f073a6aa2 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:46.799875 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-8d339af1-8a95-4020-a918-a03f073a6aa2 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:46.807015 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-8d339af1-8a95-4020-a918-a03f073a6aa2 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1240 microversion: 2.1 time: 0.093198 Apr 08 02:53:46.807587 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 361/700] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:46 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:47.585915 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-00ebd4a0-bed5-48f2-ae19-0768944dc442 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:47.587285 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-00ebd4a0-bed5-48f2-ae19-0768944dc442 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:47.595757 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-00ebd4a0-bed5-48f2-ae19-0768944dc442 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:47.596563 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-00ebd4a0-bed5-48f2-ae19-0768944dc442 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:47.597461 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-00ebd4a0-bed5-48f2-ae19-0768944dc442 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:47.598001 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-00ebd4a0-bed5-48f2-ae19-0768944dc442 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:47.800295 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-00ebd4a0-bed5-48f2-ae19-0768944dc442 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:47.810172 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-00ebd4a0-bed5-48f2-ae19-0768944dc442 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:47.811696 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-00ebd4a0-bed5-48f2-ae19-0768944dc442 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:47.812883 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-00ebd4a0-bed5-48f2-ae19-0768944dc442 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.231500 Apr 08 02:53:47.813432 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 340/701] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:47 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:47.824566 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c5bcc056-a59c-4113-9c6b-8423cfdfd3d3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:47.825745 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c5bcc056-a59c-4113-9c6b-8423cfdfd3d3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:47.835091 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c5bcc056-a59c-4113-9c6b-8423cfdfd3d3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:47.835552 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c5bcc056-a59c-4113-9c6b-8423cfdfd3d3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:47.836350 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c5bcc056-a59c-4113-9c6b-8423cfdfd3d3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:47.836783 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c5bcc056-a59c-4113-9c6b-8423cfdfd3d3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:47.966130 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c5bcc056-a59c-4113-9c6b-8423cfdfd3d3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:47.977221 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c5bcc056-a59c-4113-9c6b-8423cfdfd3d3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1244 microversion: 2.1 time: 0.156257 Apr 08 02:53:47.977909 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 362/702] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:47 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1244 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:48.833261 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b2f0193b-9c47-416c-bf94-5caad607e77e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:48.834159 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b2f0193b-9c47-416c-bf94-5caad607e77e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:48.841794 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b2f0193b-9c47-416c-bf94-5caad607e77e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:48.842468 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b2f0193b-9c47-416c-bf94-5caad607e77e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:48.843318 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b2f0193b-9c47-416c-bf94-5caad607e77e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:48.843880 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b2f0193b-9c47-416c-bf94-5caad607e77e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:48.997358 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ef373307-3bb8-4801-95dd-08ad2749ac3a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:48.997999 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ef373307-3bb8-4801-95dd-08ad2749ac3a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:49.005641 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ef373307-3bb8-4801-95dd-08ad2749ac3a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:49.006852 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ef373307-3bb8-4801-95dd-08ad2749ac3a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:49.007897 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ef373307-3bb8-4801-95dd-08ad2749ac3a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:49.008362 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ef373307-3bb8-4801-95dd-08ad2749ac3a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:49.184009 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b2f0193b-9c47-416c-bf94-5caad607e77e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:49.195315 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b2f0193b-9c47-416c-bf94-5caad607e77e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:49.197107 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b2f0193b-9c47-416c-bf94-5caad607e77e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:49.198430 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b2f0193b-9c47-416c-bf94-5caad607e77e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.369027 Apr 08 02:53:49.199425 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 341/703] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:48 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:49.351278 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ef373307-3bb8-4801-95dd-08ad2749ac3a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:49.359461 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ef373307-3bb8-4801-95dd-08ad2749ac3a tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1244 microversion: 2.1 time: 0.366051 Apr 08 02:53:49.360199 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 363/704] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:48 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1244 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:53:50.217179 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-3bab6b78-7689-49bd-8c5f-d24f9df0b5fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:50.217777 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-3bab6b78-7689-49bd-8c5f-d24f9df0b5fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:50.226038 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3bab6b78-7689-49bd-8c5f-d24f9df0b5fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:50.226483 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3bab6b78-7689-49bd-8c5f-d24f9df0b5fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:50.227258 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3bab6b78-7689-49bd-8c5f-d24f9df0b5fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:50.227692 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3bab6b78-7689-49bd-8c5f-d24f9df0b5fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:50.377233 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-6ae1b44d-c1a0-4783-80b9-59173ceeee70 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:50.378603 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-6ae1b44d-c1a0-4783-80b9-59173ceeee70 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:50.388049 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6ae1b44d-c1a0-4783-80b9-59173ceeee70 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:50.388929 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6ae1b44d-c1a0-4783-80b9-59173ceeee70 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:50.389853 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6ae1b44d-c1a0-4783-80b9-59173ceeee70 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:50.390311 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6ae1b44d-c1a0-4783-80b9-59173ceeee70 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:50.546100 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-6ae1b44d-c1a0-4783-80b9-59173ceeee70 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:50.556561 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-6ae1b44d-c1a0-4783-80b9-59173ceeee70 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1244 microversion: 2.1 time: 0.182964 Apr 08 02:53:50.557437 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 364/705] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:50 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1244 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:53:50.659369 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3bab6b78-7689-49bd-8c5f-d24f9df0b5fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:50.670145 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3bab6b78-7689-49bd-8c5f-d24f9df0b5fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:50.671664 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3bab6b78-7689-49bd-8c5f-d24f9df0b5fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:50.672825 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-3bab6b78-7689-49bd-8c5f-d24f9df0b5fe tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.459509 Apr 08 02:53:50.673375 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 342/706] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:50 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:51.087795 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 02:53:51.088072 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: Fri Apr 8 02:53:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 02:53:51.573767 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e0f66e64-c311-4cee-b831-869ace91197e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:51.574517 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e0f66e64-c311-4cee-b831-869ace91197e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:51.582977 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e0f66e64-c311-4cee-b831-869ace91197e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:51.583537 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e0f66e64-c311-4cee-b831-869ace91197e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:51.584312 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e0f66e64-c311-4cee-b831-869ace91197e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:51.584744 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e0f66e64-c311-4cee-b831-869ace91197e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:51.692434 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-3af23b27-beef-46f6-9a2b-5c4bf9ef1f19 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:51.693084 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-3af23b27-beef-46f6-9a2b-5c4bf9ef1f19 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:51.701021 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3af23b27-beef-46f6-9a2b-5c4bf9ef1f19 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:51.701520 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3af23b27-beef-46f6-9a2b-5c4bf9ef1f19 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:51.702473 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3af23b27-beef-46f6-9a2b-5c4bf9ef1f19 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:51.703108 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3af23b27-beef-46f6-9a2b-5c4bf9ef1f19 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:51.714526 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e0f66e64-c311-4cee-b831-869ace91197e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:51.724066 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e0f66e64-c311-4cee-b831-869ace91197e tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1244 microversion: 2.1 time: 0.153868 Apr 08 02:53:51.726154 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 365/707] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:51 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1244 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:53:51.945423 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3af23b27-beef-46f6-9a2b-5c4bf9ef1f19 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:51.956766 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3af23b27-beef-46f6-9a2b-5c4bf9ef1f19 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:51.958412 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3af23b27-beef-46f6-9a2b-5c4bf9ef1f19 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:51.961343 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-3af23b27-beef-46f6-9a2b-5c4bf9ef1f19 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.273256 Apr 08 02:53:51.962161 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 343/708] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:51 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:53:52.780704 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-09592c71-825a-4f9f-8265-1bb177528568 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:52.781319 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-09592c71-825a-4f9f-8265-1bb177528568 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:52.789191 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-09592c71-825a-4f9f-8265-1bb177528568 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:52.789651 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-09592c71-825a-4f9f-8265-1bb177528568 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:52.790421 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-09592c71-825a-4f9f-8265-1bb177528568 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:52.790848 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-09592c71-825a-4f9f-8265-1bb177528568 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:52.919107 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-09592c71-825a-4f9f-8265-1bb177528568 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:52.928377 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-09592c71-825a-4f9f-8265-1bb177528568 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1244 microversion: 2.1 time: 0.187943 Apr 08 02:53:52.929397 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 366/709] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:52 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1244 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:52.980315 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d332027b-bcc1-4bf2-ad86-ca3adbc2c68b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:52.980964 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-d332027b-bcc1-4bf2-ad86-ca3adbc2c68b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:52.988242 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d332027b-bcc1-4bf2-ad86-ca3adbc2c68b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:52.988688 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d332027b-bcc1-4bf2-ad86-ca3adbc2c68b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:52.989464 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d332027b-bcc1-4bf2-ad86-ca3adbc2c68b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:52.990563 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d332027b-bcc1-4bf2-ad86-ca3adbc2c68b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:53.203863 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-d332027b-bcc1-4bf2-ad86-ca3adbc2c68b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:53.213831 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-d332027b-bcc1-4bf2-ad86-ca3adbc2c68b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:53.215597 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-d332027b-bcc1-4bf2-ad86-ca3adbc2c68b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:53.216765 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-d332027b-bcc1-4bf2-ad86-ca3adbc2c68b tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.240232 Apr 08 02:53:53.217301 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 344/710] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:52 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:53.948620 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-db9ed50a-e81b-4090-9c59-7f9dd67d6df4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:53.949334 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-db9ed50a-e81b-4090-9c59-7f9dd67d6df4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:53.956693 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-db9ed50a-e81b-4090-9c59-7f9dd67d6df4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:53.957150 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-db9ed50a-e81b-4090-9c59-7f9dd67d6df4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:53.957931 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-db9ed50a-e81b-4090-9c59-7f9dd67d6df4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:53.958371 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-db9ed50a-e81b-4090-9c59-7f9dd67d6df4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:54.071754 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-db9ed50a-e81b-4090-9c59-7f9dd67d6df4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:54.081190 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-db9ed50a-e81b-4090-9c59-7f9dd67d6df4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1244 microversion: 2.1 time: 0.136223 Apr 08 02:53:54.082088 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 367/711] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:53 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1244 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:54.234755 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ff1ad379-727f-4e90-ba2f-030ade34e183 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:54.235345 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ff1ad379-727f-4e90-ba2f-030ade34e183 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:54.242915 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ff1ad379-727f-4e90-ba2f-030ade34e183 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:54.243362 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ff1ad379-727f-4e90-ba2f-030ade34e183 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:54.244168 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ff1ad379-727f-4e90-ba2f-030ade34e183 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:54.244598 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ff1ad379-727f-4e90-ba2f-030ade34e183 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:54.445343 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ff1ad379-727f-4e90-ba2f-030ade34e183 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:54.454405 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ff1ad379-727f-4e90-ba2f-030ade34e183 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:54.455918 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ff1ad379-727f-4e90-ba2f-030ade34e183 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:54.457089 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ff1ad379-727f-4e90-ba2f-030ade34e183 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.226151 Apr 08 02:53:54.457821 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 345/712] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:54 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:55.098041 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-744b9cca-23f4-4297-8e67-f530d865ff06 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:55.098655 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-744b9cca-23f4-4297-8e67-f530d865ff06 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:55.106526 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-744b9cca-23f4-4297-8e67-f530d865ff06 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:55.106971 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-744b9cca-23f4-4297-8e67-f530d865ff06 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:55.107723 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-744b9cca-23f4-4297-8e67-f530d865ff06 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:55.108182 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-744b9cca-23f4-4297-8e67-f530d865ff06 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:55.220380 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-744b9cca-23f4-4297-8e67-f530d865ff06 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:55.229126 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-744b9cca-23f4-4297-8e67-f530d865ff06 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1244 microversion: 2.1 time: 0.134714 Apr 08 02:53:55.229707 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 368/713] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:55 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1244 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:55.478012 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1a51f804-d943-4920-ad20-144a9a6b39a3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:55.478571 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1a51f804-d943-4920-ad20-144a9a6b39a3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:55.485818 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1a51f804-d943-4920-ad20-144a9a6b39a3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:55.486265 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1a51f804-d943-4920-ad20-144a9a6b39a3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:55.487026 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1a51f804-d943-4920-ad20-144a9a6b39a3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:55.487463 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1a51f804-d943-4920-ad20-144a9a6b39a3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:55.682716 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1a51f804-d943-4920-ad20-144a9a6b39a3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:55.693473 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1a51f804-d943-4920-ad20-144a9a6b39a3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:55.696360 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1a51f804-d943-4920-ad20-144a9a6b39a3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:55.698377 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1a51f804-d943-4920-ad20-144a9a6b39a3 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.224691 Apr 08 02:53:55.699247 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 346/714] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:55 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:56.149089 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-77373182-7546-48a4-9c17-7f88a75f5e39 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:56.149665 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-77373182-7546-48a4-9c17-7f88a75f5e39 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:56.156701 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-77373182-7546-48a4-9c17-7f88a75f5e39 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:56.157137 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-77373182-7546-48a4-9c17-7f88a75f5e39 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:56.157886 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-77373182-7546-48a4-9c17-7f88a75f5e39 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:56.158313 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-77373182-7546-48a4-9c17-7f88a75f5e39 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:56.218005 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-77373182-7546-48a4-9c17-7f88a75f5e39 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/ips" status: 200 len: 145 microversion: 2.1 time: 0.073799 Apr 08 02:53:56.218567 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 369/715] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Apr 8 02:53:56 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/ips => generated 145 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:53:56.246604 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a4e9c178-6bd6-4e9b-a1b4-923a2bf22b5b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:56.247308 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a4e9c178-6bd6-4e9b-a1b4-923a2bf22b5b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:56.254463 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a4e9c178-6bd6-4e9b-a1b4-923a2bf22b5b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:56.254987 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a4e9c178-6bd6-4e9b-a1b4-923a2bf22b5b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:56.256636 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a4e9c178-6bd6-4e9b-a1b4-923a2bf22b5b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:56.257144 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a4e9c178-6bd6-4e9b-a1b4-923a2bf22b5b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:56.373939 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a4e9c178-6bd6-4e9b-a1b4-923a2bf22b5b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:56.382996 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a4e9c178-6bd6-4e9b-a1b4-923a2bf22b5b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1244 microversion: 2.1 time: 0.140041 Apr 08 02:53:56.383565 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 347/716] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:56 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1244 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:56.717699 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-a40e5856-8f0b-43dc-9ab1-8bd2fea9e66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:56.718219 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-a40e5856-8f0b-43dc-9ab1-8bd2fea9e66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:56.725991 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a40e5856-8f0b-43dc-9ab1-8bd2fea9e66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:56.726438 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a40e5856-8f0b-43dc-9ab1-8bd2fea9e66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:56.727195 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a40e5856-8f0b-43dc-9ab1-8bd2fea9e66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:56.727628 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a40e5856-8f0b-43dc-9ab1-8bd2fea9e66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:56.920365 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a40e5856-8f0b-43dc-9ab1-8bd2fea9e66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:56.929963 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a40e5856-8f0b-43dc-9ab1-8bd2fea9e66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:56.931690 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a40e5856-8f0b-43dc-9ab1-8bd2fea9e66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:56.932843 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-a40e5856-8f0b-43dc-9ab1-8bd2fea9e66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.219007 Apr 08 02:53:56.933391 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 370/717] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:56 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:57.400410 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-23bd5543-2ef2-4b18-9103-2417653f4342 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:57.400999 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-23bd5543-2ef2-4b18-9103-2417653f4342 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:57.408188 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23bd5543-2ef2-4b18-9103-2417653f4342 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:57.408634 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23bd5543-2ef2-4b18-9103-2417653f4342 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:57.409393 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23bd5543-2ef2-4b18-9103-2417653f4342 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:57.409822 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-23bd5543-2ef2-4b18-9103-2417653f4342 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:57.526482 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-23bd5543-2ef2-4b18-9103-2417653f4342 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:57.535087 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-23bd5543-2ef2-4b18-9103-2417653f4342 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1244 microversion: 2.1 time: 0.139068 Apr 08 02:53:57.535680 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 348/718] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:57 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1244 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:57.666236 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d52c88e0-0ffe-46a3-a5db-994f1bc8a469 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a5e7e2c-9eb0-4c9b-ad5a-11d6846fc3c7"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:57.667382 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d52c88e0-0ffe-46a3-a5db-994f1bc8a469 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:57.674587 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d52c88e0-0ffe-46a3-a5db-994f1bc8a469 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:57.675044 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d52c88e0-0ffe-46a3-a5db-994f1bc8a469 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:57.675823 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d52c88e0-0ffe-46a3-a5db-994f1bc8a469 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:57.676274 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d52c88e0-0ffe-46a3-a5db-994f1bc8a469 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:57.951204 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-9fff9022-abc9-4d9f-91e2-f684680f8e5f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:57.951809 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-9fff9022-abc9-4d9f-91e2-f684680f8e5f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:57.959218 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9fff9022-abc9-4d9f-91e2-f684680f8e5f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:57.959672 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9fff9022-abc9-4d9f-91e2-f684680f8e5f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:57.960513 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9fff9022-abc9-4d9f-91e2-f684680f8e5f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:57.961122 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9fff9022-abc9-4d9f-91e2-f684680f8e5f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:58.077586 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d52c88e0-0ffe-46a3-a5db-994f1bc8a469 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "POST /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.415573 Apr 08 02:53:58.078403 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 371/719] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Apr 8 02:53:57 2022] POST /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments => generated 194 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:53:58.174401 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-9fff9022-abc9-4d9f-91e2-f684680f8e5f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:58.183461 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-9fff9022-abc9-4d9f-91e2-f684680f8e5f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:58.185098 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-9fff9022-abc9-4d9f-91e2-f684680f8e5f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:58.186305 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-9fff9022-abc9-4d9f-91e2-f684680f8e5f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.238806 Apr 08 02:53:58.186934 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 349/720] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:57 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:53:58.553088 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-70d21a23-a478-4f45-8887-5ff499a048c4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:58.554897 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-70d21a23-a478-4f45-8887-5ff499a048c4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:58.563500 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-70d21a23-a478-4f45-8887-5ff499a048c4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:58.563888 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-70d21a23-a478-4f45-8887-5ff499a048c4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:58.564676 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-70d21a23-a478-4f45-8887-5ff499a048c4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:58.565107 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-70d21a23-a478-4f45-8887-5ff499a048c4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:58.687418 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-70d21a23-a478-4f45-8887-5ff499a048c4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:58.695827 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-70d21a23-a478-4f45-8887-5ff499a048c4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1300 microversion: 2.1 time: 0.146849 Apr 08 02:53:58.696434 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 372/721] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:58 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1300 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:59.205073 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fb102dee-0a6a-4d86-af4f-6d50970dfd85 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:59.205676 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-fb102dee-0a6a-4d86-af4f-6d50970dfd85 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:59.214283 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb102dee-0a6a-4d86-af4f-6d50970dfd85 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:59.214728 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb102dee-0a6a-4d86-af4f-6d50970dfd85 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:59.215483 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb102dee-0a6a-4d86-af4f-6d50970dfd85 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:59.216125 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb102dee-0a6a-4d86-af4f-6d50970dfd85 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:59.524534 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fb102dee-0a6a-4d86-af4f-6d50970dfd85 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:59.537129 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fb102dee-0a6a-4d86-af4f-6d50970dfd85 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:59.538890 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fb102dee-0a6a-4d86-af4f-6d50970dfd85 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:59.539943 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-fb102dee-0a6a-4d86-af4f-6d50970dfd85 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.338672 Apr 08 02:53:59.540500 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 350/722] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:59 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:59.713780 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1ed6a3e4-0dd8-4d18-801b-5a7c48940293 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:59.714390 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1ed6a3e4-0dd8-4d18-801b-5a7c48940293 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:53:59.722055 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1ed6a3e4-0dd8-4d18-801b-5a7c48940293 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:59.722506 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1ed6a3e4-0dd8-4d18-801b-5a7c48940293 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:59.723266 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1ed6a3e4-0dd8-4d18-801b-5a7c48940293 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:59.723698 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1ed6a3e4-0dd8-4d18-801b-5a7c48940293 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:59.938256 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1ed6a3e4-0dd8-4d18-801b-5a7c48940293 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:53:59.946837 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1ed6a3e4-0dd8-4d18-801b-5a7c48940293 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1365 microversion: 2.1 time: 0.236716 Apr 08 02:53:59.947389 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 373/723] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:59 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:00.560883 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-503eb457-83cd-406a-80a8-c42a2faefa46 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:00.561520 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-503eb457-83cd-406a-80a8-c42a2faefa46 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:00.571090 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-503eb457-83cd-406a-80a8-c42a2faefa46 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:00.572013 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-503eb457-83cd-406a-80a8-c42a2faefa46 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:00.573200 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-503eb457-83cd-406a-80a8-c42a2faefa46 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:00.574457 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-503eb457-83cd-406a-80a8-c42a2faefa46 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:00.652864 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-928084d9-1c06-47b3-b8bb-572276f4ceea req-25dc8761-6f8e-4152-9966-555841f406c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfe12a9-7278-44ab-b795-c7b012fdbe6e", "tag": "105e599f-0cdc-4b32-9684-f0286bd3064f"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:00.654695 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:00.654695 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:54:00.664319 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-928084d9-1c06-47b3-b8bb-572276f4ceea req-25dc8761-6f8e-4152-9966-555841f406c0 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:00.665093 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-928084d9-1c06-47b3-b8bb-572276f4ceea req-25dc8761-6f8e-4152-9966-555841f406c0 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:00.688448 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-928084d9-1c06-47b3-b8bb-572276f4ceea req-25dc8761-6f8e-4152-9966-555841f406c0 service nova] Creating event network-changed:105e599f-0cdc-4b32-9684-f0286bd3064f for instance 7cfe12a9-7278-44ab-b795-c7b012fdbe6e on hv-cinder-83705 Apr 08 02:54:00.693325 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-928084d9-1c06-47b3-b8bb-572276f4ceea req-25dc8761-6f8e-4152-9966-555841f406c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044111 Apr 08 02:54:00.694469 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 374/724] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:00.863512 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-503eb457-83cd-406a-80a8-c42a2faefa46 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:00.872808 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-503eb457-83cd-406a-80a8-c42a2faefa46 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:00.874321 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-503eb457-83cd-406a-80a8-c42a2faefa46 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:00.875456 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-503eb457-83cd-406a-80a8-c42a2faefa46 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.319187 Apr 08 02:54:00.876241 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 351/725] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:00 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:00.965138 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-919c6574-83fa-4f1c-bae9-e0150eaa88f8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:00.965892 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-919c6574-83fa-4f1c-bae9-e0150eaa88f8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:00.973768 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-919c6574-83fa-4f1c-bae9-e0150eaa88f8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:00.974292 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-919c6574-83fa-4f1c-bae9-e0150eaa88f8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:00.975127 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-919c6574-83fa-4f1c-bae9-e0150eaa88f8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:00.976158 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-919c6574-83fa-4f1c-bae9-e0150eaa88f8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:01.201183 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-919c6574-83fa-4f1c-bae9-e0150eaa88f8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:01.210312 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-919c6574-83fa-4f1c-bae9-e0150eaa88f8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1365 microversion: 2.1 time: 0.249089 Apr 08 02:54:01.211062 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 375/726] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:00 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:01.894069 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2ce044f2-897b-4163-a42b-66c10ba0b85f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:01.894773 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2ce044f2-897b-4163-a42b-66c10ba0b85f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:01.903062 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2ce044f2-897b-4163-a42b-66c10ba0b85f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:01.903509 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2ce044f2-897b-4163-a42b-66c10ba0b85f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:01.904324 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2ce044f2-897b-4163-a42b-66c10ba0b85f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:01.904759 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2ce044f2-897b-4163-a42b-66c10ba0b85f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:02.214979 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2ce044f2-897b-4163-a42b-66c10ba0b85f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:02.223578 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2ce044f2-897b-4163-a42b-66c10ba0b85f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:02.225109 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2ce044f2-897b-4163-a42b-66c10ba0b85f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:02.226901 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-a4165be6-6eed-4bc8-9e8d-e337170decfd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:02.227483 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2ce044f2-897b-4163-a42b-66c10ba0b85f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.337227 Apr 08 02:54:02.227606 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-a4165be6-6eed-4bc8-9e8d-e337170decfd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:02.238694 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 352/727] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:01 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:02.238879 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a4165be6-6eed-4bc8-9e8d-e337170decfd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:02.238879 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a4165be6-6eed-4bc8-9e8d-e337170decfd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:02.238879 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a4165be6-6eed-4bc8-9e8d-e337170decfd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:02.238879 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a4165be6-6eed-4bc8-9e8d-e337170decfd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:02.435047 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a4165be6-6eed-4bc8-9e8d-e337170decfd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:02.443238 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-a4165be6-6eed-4bc8-9e8d-e337170decfd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1365 microversion: 2.1 time: 0.220529 Apr 08 02:54:02.443995 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 376/728] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:02 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:03.245940 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-44f5abda-3f4a-43c8-90bb-c1b925f30f36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:03.246595 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-44f5abda-3f4a-43c8-90bb-c1b925f30f36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:03.253969 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-44f5abda-3f4a-43c8-90bb-c1b925f30f36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:03.254422 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-44f5abda-3f4a-43c8-90bb-c1b925f30f36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:03.255184 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-44f5abda-3f4a-43c8-90bb-c1b925f30f36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:03.255621 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-44f5abda-3f4a-43c8-90bb-c1b925f30f36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:03.455914 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-44f5abda-3f4a-43c8-90bb-c1b925f30f36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:03.461002 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-7caec885-f25c-4b25-a218-ec5cd5f8434c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:03.461718 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-7caec885-f25c-4b25-a218-ec5cd5f8434c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:03.466224 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-44f5abda-3f4a-43c8-90bb-c1b925f30f36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:03.467724 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-44f5abda-3f4a-43c8-90bb-c1b925f30f36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:03.468861 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7caec885-f25c-4b25-a218-ec5cd5f8434c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:03.468992 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-44f5abda-3f4a-43c8-90bb-c1b925f30f36 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.226888 Apr 08 02:54:03.469314 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7caec885-f25c-4b25-a218-ec5cd5f8434c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:03.469776 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 353/729] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:03 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:03.470101 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7caec885-f25c-4b25-a218-ec5cd5f8434c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:03.470527 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7caec885-f25c-4b25-a218-ec5cd5f8434c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:03.667768 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-7caec885-f25c-4b25-a218-ec5cd5f8434c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:03.675835 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-7caec885-f25c-4b25-a218-ec5cd5f8434c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1365 microversion: 2.1 time: 0.219070 Apr 08 02:54:03.676427 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 377/730] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:03 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:04.487734 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-83b7c134-835b-4823-acb7-2169832801f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:04.488331 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-83b7c134-835b-4823-acb7-2169832801f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:04.497014 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-83b7c134-835b-4823-acb7-2169832801f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:04.497544 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-83b7c134-835b-4823-acb7-2169832801f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:04.498389 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-83b7c134-835b-4823-acb7-2169832801f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:04.498999 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-83b7c134-835b-4823-acb7-2169832801f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:04.696492 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9cb87b5a-3e51-432a-b53c-4cf1137ec04d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:04.698055 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9cb87b5a-3e51-432a-b53c-4cf1137ec04d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:04.706349 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9cb87b5a-3e51-432a-b53c-4cf1137ec04d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:04.706815 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9cb87b5a-3e51-432a-b53c-4cf1137ec04d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:04.707630 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9cb87b5a-3e51-432a-b53c-4cf1137ec04d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:04.708167 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9cb87b5a-3e51-432a-b53c-4cf1137ec04d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:04.719867 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-83b7c134-835b-4823-acb7-2169832801f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:04.730630 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-83b7c134-835b-4823-acb7-2169832801f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:04.732248 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-83b7c134-835b-4823-acb7-2169832801f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:04.734160 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-83b7c134-835b-4823-acb7-2169832801f9 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.249599 Apr 08 02:54:04.734720 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 354/731] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:04 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:04.739592 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-e54c7774-d342-484b-8d78-1bb6332f80af req-c6cd567a-ef9b-49b7-b6f4-13011359c43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66", "name": "network-vif-plugged", "status": "completed", "tag": "b1b47b52-100c-4e18-8a4a-3d16d8561d14"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:04.742523 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:04.742523 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:54:04.753409 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-e54c7774-d342-484b-8d78-1bb6332f80af req-c6cd567a-ef9b-49b7-b6f4-13011359c43d service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:04.754119 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-e54c7774-d342-484b-8d78-1bb6332f80af req-c6cd567a-ef9b-49b7-b6f4-13011359c43d service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:04.774402 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-e54c7774-d342-484b-8d78-1bb6332f80af req-c6cd567a-ef9b-49b7-b6f4-13011359c43d service nova] Creating event network-vif-plugged:b1b47b52-100c-4e18-8a4a-3d16d8561d14 for instance 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 on hv-cinder-83705 Apr 08 02:54:04.779555 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-e54c7774-d342-484b-8d78-1bb6332f80af req-c6cd567a-ef9b-49b7-b6f4-13011359c43d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043539 Apr 08 02:54:04.780351 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 355/732] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:04.989405 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9cb87b5a-3e51-432a-b53c-4cf1137ec04d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:04.998974 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9cb87b5a-3e51-432a-b53c-4cf1137ec04d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1365 microversion: 2.1 time: 0.309077 Apr 08 02:54:04.999507 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 378/733] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:04 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:05.173106 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-6de91259-3c8f-4e1d-8555-f087627f20b3 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:05.173719 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-6de91259-3c8f-4e1d-8555-f087627f20b3 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:05.181528 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6de91259-3c8f-4e1d-8555-f087627f20b3 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:05.182905 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6de91259-3c8f-4e1d-8555-f087627f20b3 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:05.183702 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6de91259-3c8f-4e1d-8555-f087627f20b3 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:05.184161 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6de91259-3c8f-4e1d-8555-f087627f20b3 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:05.246001 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.objects.instance [None req-6de91259-3c8f-4e1d-8555-f087627f20b3 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lazy-loading 'flavor' on Instance uuid c826480b-a813-4281-83a6-c743d8a84b9c {{(pid=101271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:54:05.385429 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-6de91259-3c8f-4e1d-8555-f087627f20b3 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "POST /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c/action" status: 202 len: 0 microversion: 2.1 time: 0.216355 Apr 08 02:54:05.386004 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 356/734] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Apr 8 02:54:05 2022] POST /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:54:05.394042 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-90580a68-d14d-48d5-857b-55bea4ab2bb1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:05.394658 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-90580a68-d14d-48d5-857b-55bea4ab2bb1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:05.402012 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-90580a68-d14d-48d5-857b-55bea4ab2bb1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:05.402457 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-90580a68-d14d-48d5-857b-55bea4ab2bb1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:05.403216 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-90580a68-d14d-48d5-857b-55bea4ab2bb1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:05.403651 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-90580a68-d14d-48d5-857b-55bea4ab2bb1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:05.607799 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-90580a68-d14d-48d5-857b-55bea4ab2bb1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:05.616610 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-90580a68-d14d-48d5-857b-55bea4ab2bb1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1568 microversion: 2.1 time: 0.225543 Apr 08 02:54:05.617175 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 379/735] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:05 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:05.752832 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-db38b926-581a-418b-b3f2-63c776c97cbc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:05.753527 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-db38b926-581a-418b-b3f2-63c776c97cbc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:05.761779 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-db38b926-581a-418b-b3f2-63c776c97cbc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:05.762176 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-db38b926-581a-418b-b3f2-63c776c97cbc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:05.762931 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-db38b926-581a-418b-b3f2-63c776c97cbc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:05.763454 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-db38b926-581a-418b-b3f2-63c776c97cbc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:05.880515 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-6324579c-61bd-414e-aa0f-de17b3bd4060 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:05.881501 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-6324579c-61bd-414e-aa0f-de17b3bd4060 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:05.889388 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6324579c-61bd-414e-aa0f-de17b3bd4060 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:05.889831 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6324579c-61bd-414e-aa0f-de17b3bd4060 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:05.890600 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6324579c-61bd-414e-aa0f-de17b3bd4060 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:05.891033 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6324579c-61bd-414e-aa0f-de17b3bd4060 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:05.955547 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-6324579c-61bd-414e-aa0f-de17b3bd4060 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078716 Apr 08 02:54:05.956126 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 380/736] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:54:05 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:54:05.965712 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-db38b926-581a-418b-b3f2-63c776c97cbc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:05.966755 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e5a6752c-9a65-4a5e-ae2b-c6cef81931e6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:05.967317 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e5a6752c-9a65-4a5e-ae2b-c6cef81931e6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:05.974496 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e5a6752c-9a65-4a5e-ae2b-c6cef81931e6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:05.974652 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-db38b926-581a-418b-b3f2-63c776c97cbc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:05.975066 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e5a6752c-9a65-4a5e-ae2b-c6cef81931e6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:05.975887 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e5a6752c-9a65-4a5e-ae2b-c6cef81931e6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:05.976093 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-db38b926-581a-418b-b3f2-63c776c97cbc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:05.976348 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e5a6752c-9a65-4a5e-ae2b-c6cef81931e6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:05.977417 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-db38b926-581a-418b-b3f2-63c776c97cbc tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.228720 Apr 08 02:54:05.977959 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 357/737] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:05 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:06.014820 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-afb38e36-5898-4de6-a9f5-659e5bcdadd3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:06.015540 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-afb38e36-5898-4de6-a9f5-659e5bcdadd3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:06.022665 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-afb38e36-5898-4de6-a9f5-659e5bcdadd3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:06.023212 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-afb38e36-5898-4de6-a9f5-659e5bcdadd3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:06.024138 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-afb38e36-5898-4de6-a9f5-659e5bcdadd3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:06.024651 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-afb38e36-5898-4de6-a9f5-659e5bcdadd3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:06.042659 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e5a6752c-9a65-4a5e-ae2b-c6cef81931e6 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments/7a5e7e2c-9eb0-4c9b-ad5a-11d6846fc3c7" status: 200 len: 194 microversion: 2.1 time: 0.079435 Apr 08 02:54:06.043251 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 381/738] 10.222.0.23 () {58 vars in 1412 bytes} [Fri Apr 8 02:54:05 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments/7a5e7e2c-9eb0-4c9b-ad5a-11d6846fc3c7 => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:54:06.247460 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-afb38e36-5898-4de6-a9f5-659e5bcdadd3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:06.255671 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-afb38e36-5898-4de6-a9f5-659e5bcdadd3 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1365 microversion: 2.1 time: 0.244459 Apr 08 02:54:06.256279 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 358/739] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:06 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:06.634426 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2ef65efe-fa83-4d85-b892-38b6cec3a5ea tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:06.635048 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2ef65efe-fa83-4d85-b892-38b6cec3a5ea tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:06.642921 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2ef65efe-fa83-4d85-b892-38b6cec3a5ea tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:06.643373 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2ef65efe-fa83-4d85-b892-38b6cec3a5ea tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:06.644184 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2ef65efe-fa83-4d85-b892-38b6cec3a5ea tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:06.644667 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2ef65efe-fa83-4d85-b892-38b6cec3a5ea tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:06.842179 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-2ef65efe-fa83-4d85-b892-38b6cec3a5ea tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:06.850313 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2ef65efe-fa83-4d85-b892-38b6cec3a5ea tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1568 microversion: 2.1 time: 0.219825 Apr 08 02:54:06.850867 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 382/740] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:06 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:07.058278 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2134872e-acab-4235-944a-8223ecca379a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:07.058896 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2134872e-acab-4235-944a-8223ecca379a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:07.066139 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2134872e-acab-4235-944a-8223ecca379a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:07.066590 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2134872e-acab-4235-944a-8223ecca379a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:07.067354 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2134872e-acab-4235-944a-8223ecca379a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:07.067787 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2134872e-acab-4235-944a-8223ecca379a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:07.272289 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9998dea2-64fe-4712-b915-c1b3e04e86e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:07.272895 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9998dea2-64fe-4712-b915-c1b3e04e86e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:07.274047 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2134872e-acab-4235-944a-8223ecca379a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:07.282548 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9998dea2-64fe-4712-b915-c1b3e04e86e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:07.283125 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9998dea2-64fe-4712-b915-c1b3e04e86e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:07.283409 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2134872e-acab-4235-944a-8223ecca379a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:07.283915 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9998dea2-64fe-4712-b915-c1b3e04e86e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:07.284431 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9998dea2-64fe-4712-b915-c1b3e04e86e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:07.285003 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2134872e-acab-4235-944a-8223ecca379a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:07.286164 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2134872e-acab-4235-944a-8223ecca379a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1730 microversion: 2.20 time: 0.294604 Apr 08 02:54:07.286797 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 359/741] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:06 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1730 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:07.497772 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9998dea2-64fe-4712-b915-c1b3e04e86e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:07.500468 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-323abde3-ffee-4ef2-b430-1c4cafe6cec3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be39cfc8-8dea-4d13-af41-8125632183e6"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:07.501814 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-323abde3-ffee-4ef2-b430-1c4cafe6cec3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:07.506597 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9998dea2-64fe-4712-b915-c1b3e04e86e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1365 microversion: 2.1 time: 0.237822 Apr 08 02:54:07.512006 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 383/742] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:07 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:07.515763 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-323abde3-ffee-4ef2-b430-1c4cafe6cec3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:07.516410 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-323abde3-ffee-4ef2-b430-1c4cafe6cec3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:07.517276 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-323abde3-ffee-4ef2-b430-1c4cafe6cec3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:07.517706 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-323abde3-ffee-4ef2-b430-1c4cafe6cec3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:07.869112 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-541668e8-de90-408b-a670-706fc59445a1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:07.870093 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-541668e8-de90-408b-a670-706fc59445a1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:07.878265 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-541668e8-de90-408b-a670-706fc59445a1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:07.878705 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-541668e8-de90-408b-a670-706fc59445a1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:07.879520 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-541668e8-de90-408b-a670-706fc59445a1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:07.880438 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-541668e8-de90-408b-a670-706fc59445a1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:07.887958 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-323abde3-ffee-4ef2-b430-1c4cafe6cec3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "POST /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391293 Apr 08 02:54:07.888647 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 360/743] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Apr 8 02:54:07 2022] POST /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments => generated 194 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:08.083906 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-541668e8-de90-408b-a670-706fc59445a1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:08.092798 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-541668e8-de90-408b-a670-706fc59445a1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1568 microversion: 2.1 time: 0.228435 Apr 08 02:54:08.093373 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 384/744] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:07 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:08.306105 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ce2b4c60-1485-4d05-8d68-1d3d4d824c28 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:08.307078 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ce2b4c60-1485-4d05-8d68-1d3d4d824c28 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:08.315110 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ce2b4c60-1485-4d05-8d68-1d3d4d824c28 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:08.315645 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ce2b4c60-1485-4d05-8d68-1d3d4d824c28 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:08.316390 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ce2b4c60-1485-4d05-8d68-1d3d4d824c28 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:08.316824 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ce2b4c60-1485-4d05-8d68-1d3d4d824c28 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:08.524967 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e502709b-ed42-4243-bb93-35787fe8a304 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:08.525658 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e502709b-ed42-4243-bb93-35787fe8a304 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:08.533052 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ce2b4c60-1485-4d05-8d68-1d3d4d824c28 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:08.533429 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e502709b-ed42-4243-bb93-35787fe8a304 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:08.534161 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e502709b-ed42-4243-bb93-35787fe8a304 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:08.535091 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e502709b-ed42-4243-bb93-35787fe8a304 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:08.535857 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e502709b-ed42-4243-bb93-35787fe8a304 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:08.546879 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ce2b4c60-1485-4d05-8d68-1d3d4d824c28 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:08.548785 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ce2b4c60-1485-4d05-8d68-1d3d4d824c28 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:08.550372 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ce2b4c60-1485-4d05-8d68-1d3d4d824c28 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1717 microversion: 2.20 time: 0.248965 Apr 08 02:54:08.559122 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 361/745] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:08 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1717 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:08.564603 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-1994a3b8-7fcd-481f-88a0-a2ccff14ff09 req-2ee9d312-2ea8-4e4b-ab65-6e37d20ba935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfe12a9-7278-44ab-b795-c7b012fdbe6e", "name": "network-vif-plugged", "status": "completed", "tag": "105e599f-0cdc-4b32-9684-f0286bd3064f"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:08.566760 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:08.566760 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:54:08.577151 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-1994a3b8-7fcd-481f-88a0-a2ccff14ff09 req-2ee9d312-2ea8-4e4b-ab65-6e37d20ba935 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:08.577911 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-1994a3b8-7fcd-481f-88a0-a2ccff14ff09 req-2ee9d312-2ea8-4e4b-ab65-6e37d20ba935 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:08.595234 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-1994a3b8-7fcd-481f-88a0-a2ccff14ff09 req-2ee9d312-2ea8-4e4b-ab65-6e37d20ba935 service nova] Creating event network-vif-plugged:105e599f-0cdc-4b32-9684-f0286bd3064f for instance 7cfe12a9-7278-44ab-b795-c7b012fdbe6e on hv-cinder-83705 Apr 08 02:54:08.604453 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-1994a3b8-7fcd-481f-88a0-a2ccff14ff09 req-2ee9d312-2ea8-4e4b-ab65-6e37d20ba935 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043611 Apr 08 02:54:08.606984 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 362/746] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:08.749943 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e502709b-ed42-4243-bb93-35787fe8a304 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:08.760204 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e502709b-ed42-4243-bb93-35787fe8a304 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1365 microversion: 2.1 time: 0.240122 Apr 08 02:54:08.761195 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 385/747] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:08 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:09.111390 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-3eba1fa8-b08b-4fa9-b445-12e89c938f42 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:09.112134 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-3eba1fa8-b08b-4fa9-b445-12e89c938f42 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:09.120061 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3eba1fa8-b08b-4fa9-b445-12e89c938f42 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:09.120514 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3eba1fa8-b08b-4fa9-b445-12e89c938f42 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:09.121276 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3eba1fa8-b08b-4fa9-b445-12e89c938f42 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:09.121711 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-3eba1fa8-b08b-4fa9-b445-12e89c938f42 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:09.318939 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3eba1fa8-b08b-4fa9-b445-12e89c938f42 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:09.327079 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-3eba1fa8-b08b-4fa9-b445-12e89c938f42 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1568 microversion: 2.1 time: 0.220319 Apr 08 02:54:09.327637 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 363/748] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:09 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:09.777173 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-cfdf865f-4a09-4c1f-886c-06a57695545b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:09.777767 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-cfdf865f-4a09-4c1f-886c-06a57695545b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:09.785018 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cfdf865f-4a09-4c1f-886c-06a57695545b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:09.785467 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cfdf865f-4a09-4c1f-886c-06a57695545b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:09.786231 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cfdf865f-4a09-4c1f-886c-06a57695545b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:09.786671 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cfdf865f-4a09-4c1f-886c-06a57695545b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:09.984548 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cfdf865f-4a09-4c1f-886c-06a57695545b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:09.993269 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-cfdf865f-4a09-4c1f-886c-06a57695545b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1365 microversion: 2.1 time: 0.220412 Apr 08 02:54:09.993821 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 386/749] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:09 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:10.344188 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-6e4f0494-8757-428c-b58c-33b78ef1d7ae tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:10.344797 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-6e4f0494-8757-428c-b58c-33b78ef1d7ae tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:10.353184 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6e4f0494-8757-428c-b58c-33b78ef1d7ae tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:10.353872 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6e4f0494-8757-428c-b58c-33b78ef1d7ae tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:10.355579 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6e4f0494-8757-428c-b58c-33b78ef1d7ae tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:10.356275 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6e4f0494-8757-428c-b58c-33b78ef1d7ae tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:10.555296 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-6e4f0494-8757-428c-b58c-33b78ef1d7ae tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:10.563687 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-6e4f0494-8757-428c-b58c-33b78ef1d7ae tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1568 microversion: 2.1 time: 0.223511 Apr 08 02:54:10.564278 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 364/750] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:10 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:11.010585 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b9ea912f-6866-4fea-b79d-192e3d482ce4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:11.011155 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b9ea912f-6866-4fea-b79d-192e3d482ce4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:11.018511 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b9ea912f-6866-4fea-b79d-192e3d482ce4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:11.018963 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b9ea912f-6866-4fea-b79d-192e3d482ce4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:11.019726 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b9ea912f-6866-4fea-b79d-192e3d482ce4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:11.020206 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b9ea912f-6866-4fea-b79d-192e3d482ce4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:11.229502 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b9ea912f-6866-4fea-b79d-192e3d482ce4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:11.237467 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b9ea912f-6866-4fea-b79d-192e3d482ce4 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1555 microversion: 2.1 time: 0.231226 Apr 08 02:54:11.238013 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 387/751] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:11 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:11.258682 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-32033ea1-56b5-40d4-8558-6dc744c41d07 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:11.259198 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-32033ea1-56b5-40d4-8558-6dc744c41d07 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:11.266885 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-32033ea1-56b5-40d4-8558-6dc744c41d07 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:11.267280 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-32033ea1-56b5-40d4-8558-6dc744c41d07 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:11.268074 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-32033ea1-56b5-40d4-8558-6dc744c41d07 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:11.268512 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-32033ea1-56b5-40d4-8558-6dc744c41d07 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:11.411255 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-32033ea1-56b5-40d4-8558-6dc744c41d07 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.156875 Apr 08 02:54:11.411849 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 365/752] 10.222.0.23 () {58 vars in 1274 bytes} [Fri Apr 8 02:54:11 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-interface => generated 285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:11.580656 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-186b227c-066e-489b-9538-3372535a4ba7 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:11.581310 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-186b227c-066e-489b-9538-3372535a4ba7 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:11.588621 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-186b227c-066e-489b-9538-3372535a4ba7 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:11.589073 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-186b227c-066e-489b-9538-3372535a4ba7 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:11.589843 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-186b227c-066e-489b-9538-3372535a4ba7 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:11.590283 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-186b227c-066e-489b-9538-3372535a4ba7 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:11.790404 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-186b227c-066e-489b-9538-3372535a4ba7 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:11.798826 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-186b227c-066e-489b-9538-3372535a4ba7 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1568 microversion: 2.1 time: 0.221983 Apr 08 02:54:11.799390 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 388/753] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:11 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:12.816739 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fc671b10-1cbf-4450-81ed-776562b065c2 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:12.817358 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-fc671b10-1cbf-4450-81ed-776562b065c2 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:12.825217 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fc671b10-1cbf-4450-81ed-776562b065c2 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:12.826352 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fc671b10-1cbf-4450-81ed-776562b065c2 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:12.827166 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fc671b10-1cbf-4450-81ed-776562b065c2 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:12.827606 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fc671b10-1cbf-4450-81ed-776562b065c2 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:13.082153 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-1e36fd84-42be-4d16-b393-17a3b114aaaa req-48f34375-1fbe-4a01-853a-555d1b3ecaa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfe12a9-7278-44ab-b795-c7b012fdbe6e", "tag": "105e599f-0cdc-4b32-9684-f0286bd3064f"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:13.084100 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:13.084100 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:54:13.092555 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-1e36fd84-42be-4d16-b393-17a3b114aaaa req-48f34375-1fbe-4a01-853a-555d1b3ecaa3 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:13.093029 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-1e36fd84-42be-4d16-b393-17a3b114aaaa req-48f34375-1fbe-4a01-853a-555d1b3ecaa3 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:13.110485 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-1e36fd84-42be-4d16-b393-17a3b114aaaa req-48f34375-1fbe-4a01-853a-555d1b3ecaa3 service nova] Creating event network-changed:105e599f-0cdc-4b32-9684-f0286bd3064f for instance 7cfe12a9-7278-44ab-b795-c7b012fdbe6e on hv-cinder-83705 Apr 08 02:54:13.115460 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-1e36fd84-42be-4d16-b393-17a3b114aaaa req-48f34375-1fbe-4a01-853a-555d1b3ecaa3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036985 Apr 08 02:54:13.116562 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 389/754] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:13.161277 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fc671b10-1cbf-4450-81ed-776562b065c2 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:13.170264 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-fc671b10-1cbf-4450-81ed-776562b065c2 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1568 microversion: 2.1 time: 0.357424 Apr 08 02:54:13.170830 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 366/755] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:12 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1568 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:14.187116 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5a043ac1-c1fc-42e9-9940-ebe2514c93e0 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:14.187810 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5a043ac1-c1fc-42e9-9940-ebe2514c93e0 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:14.196430 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5a043ac1-c1fc-42e9-9940-ebe2514c93e0 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:14.196878 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5a043ac1-c1fc-42e9-9940-ebe2514c93e0 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:14.197636 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5a043ac1-c1fc-42e9-9940-ebe2514c93e0 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:14.198070 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5a043ac1-c1fc-42e9-9940-ebe2514c93e0 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:14.417503 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5a043ac1-c1fc-42e9-9940-ebe2514c93e0 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:14.429194 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5a043ac1-c1fc-42e9-9940-ebe2514c93e0 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1568 microversion: 2.1 time: 0.246041 Apr 08 02:54:14.434640 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 390/756] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:14 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:15.450660 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-dd698c21-9ec3-4783-8502-bcd5dafe7078 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:15.451197 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-dd698c21-9ec3-4783-8502-bcd5dafe7078 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:15.458838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-dd698c21-9ec3-4783-8502-bcd5dafe7078 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:15.459265 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-dd698c21-9ec3-4783-8502-bcd5dafe7078 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:15.460042 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-dd698c21-9ec3-4783-8502-bcd5dafe7078 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:15.460472 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-dd698c21-9ec3-4783-8502-bcd5dafe7078 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:15.657794 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-dd698c21-9ec3-4783-8502-bcd5dafe7078 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:15.666716 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-dd698c21-9ec3-4783-8502-bcd5dafe7078 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1568 microversion: 2.1 time: 0.219770 Apr 08 02:54:15.667281 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 367/757] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:15 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:15.671566 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-eeca1977-c6a7-4ffd-a6db-a544e238ab89 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:15.672624 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-eeca1977-c6a7-4ffd-a6db-a544e238ab89 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:15.680875 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-eeca1977-c6a7-4ffd-a6db-a544e238ab89 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:15.681598 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-eeca1977-c6a7-4ffd-a6db-a544e238ab89 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:15.682369 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-eeca1977-c6a7-4ffd-a6db-a544e238ab89 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:15.682873 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-eeca1977-c6a7-4ffd-a6db-a544e238ab89 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:15.747491 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-eeca1977-c6a7-4ffd-a6db-a544e238ab89 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.079796 Apr 08 02:54:15.747980 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 391/758] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:54:15 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:54:15.891563 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c31cfffd-a5bf-4151-b3ed-82b1a4b3e064 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:15.892217 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c31cfffd-a5bf-4151-b3ed-82b1a4b3e064 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:15.899492 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c31cfffd-a5bf-4151-b3ed-82b1a4b3e064 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:15.900091 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c31cfffd-a5bf-4151-b3ed-82b1a4b3e064 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:15.900868 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c31cfffd-a5bf-4151-b3ed-82b1a4b3e064 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:15.901305 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c31cfffd-a5bf-4151-b3ed-82b1a4b3e064 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:15.966829 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c31cfffd-a5bf-4151-b3ed-82b1a4b3e064 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments/7a5e7e2c-9eb0-4c9b-ad5a-11d6846fc3c7" status: 200 len: 194 microversion: 2.1 time: 0.079044 Apr 08 02:54:15.967569 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 368/759] 10.222.0.23 () {58 vars in 1412 bytes} [Fri Apr 8 02:54:15 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments/7a5e7e2c-9eb0-4c9b-ad5a-11d6846fc3c7 => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:15.976800 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-7232dcb5-bdb5-46fa-846c-448ea86ecef3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:15.977340 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-7232dcb5-bdb5-46fa-846c-448ea86ecef3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:15.984503 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7232dcb5-bdb5-46fa-846c-448ea86ecef3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:15.984951 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7232dcb5-bdb5-46fa-846c-448ea86ecef3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:15.985751 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7232dcb5-bdb5-46fa-846c-448ea86ecef3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:15.986191 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7232dcb5-bdb5-46fa-846c-448ea86ecef3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:16.137963 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.objects.instance [None req-7232dcb5-bdb5-46fa-846c-448ea86ecef3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lazy-loading 'services' on Instance uuid dc8070c3-de05-4d72-a6c7-8ec58bd750c5 {{(pid=101272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:54:16.285482 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-7232dcb5-bdb5-46fa-846c-448ea86ecef3 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments/7a5e7e2c-9eb0-4c9b-ad5a-11d6846fc3c7" status: 202 len: 0 microversion: 2.1 time: 0.312296 Apr 08 02:54:16.286160 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 392/760] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Apr 8 02:54:15 2022] DELETE /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments/7a5e7e2c-9eb0-4c9b-ad5a-11d6846fc3c7 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:54:16.683313 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5ebfaabd-a484-420f-9832-3bd8615ad0e1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:16.684055 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-5ebfaabd-a484-420f-9832-3bd8615ad0e1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:16.691313 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5ebfaabd-a484-420f-9832-3bd8615ad0e1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:16.691767 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5ebfaabd-a484-420f-9832-3bd8615ad0e1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:16.692568 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5ebfaabd-a484-420f-9832-3bd8615ad0e1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:16.693008 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5ebfaabd-a484-420f-9832-3bd8615ad0e1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:16.887155 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5ebfaabd-a484-420f-9832-3bd8615ad0e1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:16.895316 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-5ebfaabd-a484-420f-9832-3bd8615ad0e1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1568 microversion: 2.1 time: 0.216656 Apr 08 02:54:16.895871 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 369/761] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:16 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:17.912290 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c6459531-0afc-40a1-96e2-fd9491083a29 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:17.912905 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c6459531-0afc-40a1-96e2-fd9491083a29 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:17.920575 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c6459531-0afc-40a1-96e2-fd9491083a29 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:17.921035 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c6459531-0afc-40a1-96e2-fd9491083a29 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:17.921804 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c6459531-0afc-40a1-96e2-fd9491083a29 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:17.922244 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c6459531-0afc-40a1-96e2-fd9491083a29 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:18.115631 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c6459531-0afc-40a1-96e2-fd9491083a29 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:18.125160 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c6459531-0afc-40a1-96e2-fd9491083a29 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1568 microversion: 2.1 time: 0.217147 Apr 08 02:54:18.125723 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 393/762] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:17 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:18.556657 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8f840261-4615-4172-8afe-0322a692d35f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:18.557185 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-8f840261-4615-4172-8afe-0322a692d35f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:18.564514 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8f840261-4615-4172-8afe-0322a692d35f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:18.564958 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8f840261-4615-4172-8afe-0322a692d35f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:18.565720 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8f840261-4615-4172-8afe-0322a692d35f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:18.566150 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8f840261-4615-4172-8afe-0322a692d35f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:18.629502 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8f840261-4615-4172-8afe-0322a692d35f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments/be39cfc8-8dea-4d13-af41-8125632183e6" status: 200 len: 194 microversion: 2.1 time: 0.077711 Apr 08 02:54:18.630094 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 370/763] 10.222.0.23 () {58 vars in 1412 bytes} [Fri Apr 8 02:54:18 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments/be39cfc8-8dea-4d13-af41-8125632183e6 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:18.640290 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-a0e40c6f-5bf1-4c40-bfbc-585a486d0e4f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:18.640865 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-a0e40c6f-5bf1-4c40-bfbc-585a486d0e4f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:18.648104 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a0e40c6f-5bf1-4c40-bfbc-585a486d0e4f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:18.648630 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a0e40c6f-5bf1-4c40-bfbc-585a486d0e4f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:18.650241 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a0e40c6f-5bf1-4c40-bfbc-585a486d0e4f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:18.650772 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a0e40c6f-5bf1-4c40-bfbc-585a486d0e4f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:18.809089 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.objects.instance [None req-a0e40c6f-5bf1-4c40-bfbc-585a486d0e4f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lazy-loading 'services' on Instance uuid dc8070c3-de05-4d72-a6c7-8ec58bd750c5 {{(pid=101272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:54:18.954755 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-a0e40c6f-5bf1-4c40-bfbc-585a486d0e4f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments/be39cfc8-8dea-4d13-af41-8125632183e6" status: 202 len: 0 microversion: 2.1 time: 0.318062 Apr 08 02:54:18.955338 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 394/764] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Apr 8 02:54:18 2022] DELETE /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments/be39cfc8-8dea-4d13-af41-8125632183e6 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:54:19.142893 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-acf4e7d1-8747-42aa-bb97-b016d3957462 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:19.143506 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-acf4e7d1-8747-42aa-bb97-b016d3957462 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:19.152286 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-acf4e7d1-8747-42aa-bb97-b016d3957462 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:19.152737 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-acf4e7d1-8747-42aa-bb97-b016d3957462 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:19.153503 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-acf4e7d1-8747-42aa-bb97-b016d3957462 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:19.153938 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-acf4e7d1-8747-42aa-bb97-b016d3957462 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:19.357244 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-acf4e7d1-8747-42aa-bb97-b016d3957462 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:19.366222 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-acf4e7d1-8747-42aa-bb97-b016d3957462 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1569 microversion: 2.1 time: 0.227036 Apr 08 02:54:19.366796 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 371/765] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:19 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:19.382978 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-95c1ab23-153b-401b-9a8f-eef94fcff84e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:19.384202 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-95c1ab23-153b-401b-9a8f-eef94fcff84e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:19.391563 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-95c1ab23-153b-401b-9a8f-eef94fcff84e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:19.392046 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-95c1ab23-153b-401b-9a8f-eef94fcff84e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:19.392808 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-95c1ab23-153b-401b-9a8f-eef94fcff84e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:19.393240 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-95c1ab23-153b-401b-9a8f-eef94fcff84e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:19.536744 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-95c1ab23-153b-401b-9a8f-eef94fcff84e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "POST /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c/action" status: 202 len: 0 microversion: 2.1 time: 0.157640 Apr 08 02:54:19.537351 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 395/766] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Apr 8 02:54:19 2022] POST /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:54:19.545512 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e2052724-1b9c-4aa1-8b83-702bdabf01f4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:19.546280 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e2052724-1b9c-4aa1-8b83-702bdabf01f4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:19.553955 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e2052724-1b9c-4aa1-8b83-702bdabf01f4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:19.554412 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e2052724-1b9c-4aa1-8b83-702bdabf01f4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:19.555777 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e2052724-1b9c-4aa1-8b83-702bdabf01f4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:19.556537 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e2052724-1b9c-4aa1-8b83-702bdabf01f4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:19.785545 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e2052724-1b9c-4aa1-8b83-702bdabf01f4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:19.794205 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e2052724-1b9c-4aa1-8b83-702bdabf01f4 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1577 microversion: 2.1 time: 0.252647 Apr 08 02:54:19.794756 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 372/767] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:19 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1577 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:20.227895 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-8be9ddf3-8cfd-4893-9707-7af42b049382 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:20.228927 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-8be9ddf3-8cfd-4893-9707-7af42b049382 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:20.236828 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8be9ddf3-8cfd-4893-9707-7af42b049382 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:20.237280 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8be9ddf3-8cfd-4893-9707-7af42b049382 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:20.238071 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8be9ddf3-8cfd-4893-9707-7af42b049382 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:20.238534 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8be9ddf3-8cfd-4893-9707-7af42b049382 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:20.303919 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-8be9ddf3-8cfd-4893-9707-7af42b049382 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080068 Apr 08 02:54:20.304772 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 396/768] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:54:20 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:54:20.477680 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a8647c04-38f5-45b2-9eb8-2ef993199937 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:20.478990 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a8647c04-38f5-45b2-9eb8-2ef993199937 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:20.486634 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a8647c04-38f5-45b2-9eb8-2ef993199937 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:20.487162 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a8647c04-38f5-45b2-9eb8-2ef993199937 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:20.488190 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a8647c04-38f5-45b2-9eb8-2ef993199937 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:20.488688 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a8647c04-38f5-45b2-9eb8-2ef993199937 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:20.554202 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a8647c04-38f5-45b2-9eb8-2ef993199937 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080842 Apr 08 02:54:20.554759 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 373/769] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:54:20 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:54:20.641073 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c41d6ae9-6e9f-4cc7-8556-fbfff4cc74af tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:20.641572 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c41d6ae9-6e9f-4cc7-8556-fbfff4cc74af tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:20.648673 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c41d6ae9-6e9f-4cc7-8556-fbfff4cc74af tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:20.649688 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c41d6ae9-6e9f-4cc7-8556-fbfff4cc74af tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:20.650451 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c41d6ae9-6e9f-4cc7-8556-fbfff4cc74af tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:20.650880 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c41d6ae9-6e9f-4cc7-8556-fbfff4cc74af tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:20.714454 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c41d6ae9-6e9f-4cc7-8556-fbfff4cc74af tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Going to try to terminate instance {{(pid=101272) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:54:20.812083 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-11dcee49-13ed-414a-80f8-080c7005040e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:20.812700 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-11dcee49-13ed-414a-80f8-080c7005040e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:20.820395 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-11dcee49-13ed-414a-80f8-080c7005040e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:20.821356 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-11dcee49-13ed-414a-80f8-080c7005040e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:20.822233 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-11dcee49-13ed-414a-80f8-080c7005040e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:20.822821 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-11dcee49-13ed-414a-80f8-080c7005040e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:20.823473 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c41d6ae9-6e9f-4cc7-8556-fbfff4cc74af tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 204 len: 0 microversion: 2.1 time: 0.185755 Apr 08 02:54:20.824282 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 397/770] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:54:20 2022] DELETE /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:54:20.832925 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d84063db-d04b-44e7-9bf8-c3d1980dcc5f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:20.833641 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d84063db-d04b-44e7-9bf8-c3d1980dcc5f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:20.841532 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d84063db-d04b-44e7-9bf8-c3d1980dcc5f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:20.841975 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d84063db-d04b-44e7-9bf8-c3d1980dcc5f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:20.842747 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d84063db-d04b-44e7-9bf8-c3d1980dcc5f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:20.843188 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d84063db-d04b-44e7-9bf8-c3d1980dcc5f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:21.022957 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-11dcee49-13ed-414a-80f8-080c7005040e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:21.031888 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-11dcee49-13ed-414a-80f8-080c7005040e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1519 microversion: 2.1 time: 0.223488 Apr 08 02:54:21.033157 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 374/771] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:20 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1519 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:21.044828 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d84063db-d04b-44e7-9bf8-c3d1980dcc5f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:21.053571 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d84063db-d04b-44e7-9bf8-c3d1980dcc5f tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 200 len: 1673 microversion: 2.1 time: 0.225029 Apr 08 02:54:21.054130 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 398/772] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:20 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 1673 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:22.049198 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e9c0cf45-61cf-4d43-9ed0-56886bfcbaa1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:22.049741 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e9c0cf45-61cf-4d43-9ed0-56886bfcbaa1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:22.057484 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e9c0cf45-61cf-4d43-9ed0-56886bfcbaa1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:22.057932 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e9c0cf45-61cf-4d43-9ed0-56886bfcbaa1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:22.058693 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e9c0cf45-61cf-4d43-9ed0-56886bfcbaa1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:22.059123 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e9c0cf45-61cf-4d43-9ed0-56886bfcbaa1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:22.072662 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-75dd0659-cf8c-43e8-8925-7e912584bb54 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:22.073541 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-75dd0659-cf8c-43e8-8925-7e912584bb54 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:22.080838 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-75dd0659-cf8c-43e8-8925-7e912584bb54 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:22.081279 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-75dd0659-cf8c-43e8-8925-7e912584bb54 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:22.082043 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-75dd0659-cf8c-43e8-8925-7e912584bb54 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:22.082471 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-75dd0659-cf8c-43e8-8925-7e912584bb54 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:22.282069 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-75dd0659-cf8c-43e8-8925-7e912584bb54 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:22.290648 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-75dd0659-cf8c-43e8-8925-7e912584bb54 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 200 len: 1673 microversion: 2.1 time: 0.222762 Apr 08 02:54:22.291561 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 399/773] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:22 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 1673 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:22.356368 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e9c0cf45-61cf-4d43-9ed0-56886bfcbaa1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:22.364823 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e9c0cf45-61cf-4d43-9ed0-56886bfcbaa1 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1575 microversion: 2.1 time: 0.319402 Apr 08 02:54:22.365630 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 375/774] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:22 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1575 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:22.497720 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-4f8cee64-aa7f-4409-9854-288b0b694a33 req-d2dc5856-5c85-46bd-bf7a-b4c4efd1bd15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c826480b-a813-4281-83a6-c743d8a84b9c", "name": "network-vif-unplugged", "status": "completed", "tag": "105b6cec-7cb5-414f-809c-11a2bc5ec384"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:22.499735 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:22.499735 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:54:22.511239 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-4f8cee64-aa7f-4409-9854-288b0b694a33 req-d2dc5856-5c85-46bd-bf7a-b4c4efd1bd15 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:22.512150 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-4f8cee64-aa7f-4409-9854-288b0b694a33 req-d2dc5856-5c85-46bd-bf7a-b4c4efd1bd15 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:22.528720 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-4f8cee64-aa7f-4409-9854-288b0b694a33 req-d2dc5856-5c85-46bd-bf7a-b4c4efd1bd15 service nova] Creating event network-vif-unplugged:105b6cec-7cb5-414f-809c-11a2bc5ec384 for instance c826480b-a813-4281-83a6-c743d8a84b9c on hv-cinder-83705 Apr 08 02:54:22.533433 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-4f8cee64-aa7f-4409-9854-288b0b694a33 req-d2dc5856-5c85-46bd-bf7a-b4c4efd1bd15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039461 Apr 08 02:54:22.534033 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 400/775] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:23.308200 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5ca7f00a-1c6b-46c8-b30c-a776dc171d86 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:23.308976 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-5ca7f00a-1c6b-46c8-b30c-a776dc171d86 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:23.316147 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5ca7f00a-1c6b-46c8-b30c-a776dc171d86 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:23.316600 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5ca7f00a-1c6b-46c8-b30c-a776dc171d86 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:23.317377 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5ca7f00a-1c6b-46c8-b30c-a776dc171d86 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:23.317807 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5ca7f00a-1c6b-46c8-b30c-a776dc171d86 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:23.382540 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ffa6f1e1-1d33-4a5d-af3e-5f25fbd3b4a2 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:23.383373 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ffa6f1e1-1d33-4a5d-af3e-5f25fbd3b4a2 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:23.391115 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ffa6f1e1-1d33-4a5d-af3e-5f25fbd3b4a2 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:23.391547 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ffa6f1e1-1d33-4a5d-af3e-5f25fbd3b4a2 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:23.392341 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ffa6f1e1-1d33-4a5d-af3e-5f25fbd3b4a2 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:23.392771 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ffa6f1e1-1d33-4a5d-af3e-5f25fbd3b4a2 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:23.609178 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ffa6f1e1-1d33-4a5d-af3e-5f25fbd3b4a2 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:23.617495 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ffa6f1e1-1d33-4a5d-af3e-5f25fbd3b4a2 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1575 microversion: 2.1 time: 0.238878 Apr 08 02:54:23.618139 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 401/776] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:23 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1575 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:23.856605 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5ca7f00a-1c6b-46c8-b30c-a776dc171d86 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:23.864845 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-5ca7f00a-1c6b-46c8-b30c-a776dc171d86 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 200 len: 1673 microversion: 2.1 time: 0.560812 Apr 08 02:54:23.865416 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 376/777] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:23 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 1673 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:24.634347 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-029a8487-38aa-431b-8723-eff5f0f22d2b tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:24.634955 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-029a8487-38aa-431b-8723-eff5f0f22d2b tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:24.642057 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-029a8487-38aa-431b-8723-eff5f0f22d2b tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:24.642502 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-029a8487-38aa-431b-8723-eff5f0f22d2b tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:24.643260 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-029a8487-38aa-431b-8723-eff5f0f22d2b tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:24.643692 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-029a8487-38aa-431b-8723-eff5f0f22d2b tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:24.829936 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-aa8c320e-ec48-4474-853f-c686b7a74aca req-b71594bd-abb7-4827-bdb5-8ac86c5306c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8070c3-de05-4d72-a6c7-8ec58bd750c5", "name": "network-vif-deleted", "tag": "2ccf4c17-cdc0-445d-8a18-659878ac2d69"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:24.832967 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:24.832967 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:54:24.855407 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-029a8487-38aa-431b-8723-eff5f0f22d2b tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:24.858406 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-aa8c320e-ec48-4474-853f-c686b7a74aca req-b71594bd-abb7-4827-bdb5-8ac86c5306c7 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:24.858858 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-aa8c320e-ec48-4474-853f-c686b7a74aca req-b71594bd-abb7-4827-bdb5-8ac86c5306c7 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:24.864578 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-029a8487-38aa-431b-8723-eff5f0f22d2b tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1575 microversion: 2.1 time: 0.233966 Apr 08 02:54:24.865776 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 402/778] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:24 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1575 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:24.883902 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-653c5b4a-8c5b-49a7-8368-718a42f32d6b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:24.884401 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-653c5b4a-8c5b-49a7-8368-718a42f32d6b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:24.886805 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-aa8c320e-ec48-4474-853f-c686b7a74aca req-b71594bd-abb7-4827-bdb5-8ac86c5306c7 service nova] Creating event network-vif-deleted:2ccf4c17-cdc0-445d-8a18-659878ac2d69 for instance dc8070c3-de05-4d72-a6c7-8ec58bd750c5 on hv-cinder-83705 Apr 08 02:54:24.893102 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-aa8c320e-ec48-4474-853f-c686b7a74aca req-b71594bd-abb7-4827-bdb5-8ac86c5306c7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066459 Apr 08 02:54:24.895248 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 377/779] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:24.900668 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-653c5b4a-8c5b-49a7-8368-718a42f32d6b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:24.901221 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-653c5b4a-8c5b-49a7-8368-718a42f32d6b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:24.902101 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-653c5b4a-8c5b-49a7-8368-718a42f32d6b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:24.902787 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-653c5b4a-8c5b-49a7-8368-718a42f32d6b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:25.029584 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-653c5b4a-8c5b-49a7-8368-718a42f32d6b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008fc39c532a4a0ca8fc83e0d244a370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16870ad51e0f4d1d9d73d3922e34a632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:25.038301 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-653c5b4a-8c5b-49a7-8368-718a42f32d6b tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 200 len: 1323 microversion: 2.1 time: 0.159618 Apr 08 02:54:25.038950 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 403/780] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:24 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 1323 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:25.884653 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ee039216-7d1e-40f7-9cc7-2a04e4f55d57 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:25.885528 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ee039216-7d1e-40f7-9cc7-2a04e4f55d57 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:25.893306 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ee039216-7d1e-40f7-9cc7-2a04e4f55d57 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:25.893830 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ee039216-7d1e-40f7-9cc7-2a04e4f55d57 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:25.894619 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ee039216-7d1e-40f7-9cc7-2a04e4f55d57 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:25.895082 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ee039216-7d1e-40f7-9cc7-2a04e4f55d57 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:26.056700 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-18fd9dc6-1c60-48b7-a195-2c95e65c098e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:26.057335 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-18fd9dc6-1c60-48b7-a195-2c95e65c098e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:26.065023 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-18fd9dc6-1c60-48b7-a195-2c95e65c098e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:26.065730 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-18fd9dc6-1c60-48b7-a195-2c95e65c098e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:26.066945 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-18fd9dc6-1c60-48b7-a195-2c95e65c098e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:26.067801 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-18fd9dc6-1c60-48b7-a195-2c95e65c098e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:26.107422 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ee039216-7d1e-40f7-9cc7-2a04e4f55d57 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:26.118386 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ee039216-7d1e-40f7-9cc7-2a04e4f55d57 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1575 microversion: 2.1 time: 0.239317 Apr 08 02:54:26.119516 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 378/781] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:25 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:26.123541 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-18fd9dc6-1c60-48b7-a195-2c95e65c098e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] HTTP exception thrown: Instance dc8070c3-de05-4d72-a6c7-8ec58bd750c5 could not be found. Apr 08 02:54:26.124192 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-18fd9dc6-1c60-48b7-a195-2c95e65c098e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Returning 404 to user: Instance dc8070c3-de05-4d72-a6c7-8ec58bd750c5 could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:54:26.125526 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-18fd9dc6-1c60-48b7-a195-2c95e65c098e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 404 len: 111 microversion: 2.1 time: 0.073139 Apr 08 02:54:26.126583 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 404/782] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:26 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:54:26.135607 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-6142695c-4afc-44ac-9fff-728cc17bef75 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '.version_select at 0x7fbc38606dc0>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:26.153217 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-6142695c-4afc-44ac-9fff-728cc17bef75 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175488171" status: 202 len: 0 microversion: 2.1 time: 0.021991 Apr 08 02:54:26.153783 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 379/783] 10.222.0.23 () {58 vars in 1220 bytes} [Fri Apr 8 02:54:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175488171 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:54:27.140784 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3a7c3b24-0087-4f6b-8057-2c8f9b9a3f3f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:27.141619 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-3a7c3b24-0087-4f6b-8057-2c8f9b9a3f3f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:27.149726 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3a7c3b24-0087-4f6b-8057-2c8f9b9a3f3f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:27.150268 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3a7c3b24-0087-4f6b-8057-2c8f9b9a3f3f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:27.151058 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3a7c3b24-0087-4f6b-8057-2c8f9b9a3f3f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:27.151497 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3a7c3b24-0087-4f6b-8057-2c8f9b9a3f3f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:27.351912 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-3a7c3b24-0087-4f6b-8057-2c8f9b9a3f3f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:27.360706 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3a7c3b24-0087-4f6b-8057-2c8f9b9a3f3f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1575 microversion: 2.1 time: 0.223586 Apr 08 02:54:27.361264 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 405/784] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:27 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:28.378017 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-19898738-2d87-4237-88ec-84b4574a802a tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:28.378630 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-19898738-2d87-4237-88ec-84b4574a802a tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:28.385893 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-19898738-2d87-4237-88ec-84b4574a802a tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:28.386343 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-19898738-2d87-4237-88ec-84b4574a802a tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:28.387107 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-19898738-2d87-4237-88ec-84b4574a802a tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:28.387543 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-19898738-2d87-4237-88ec-84b4574a802a tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:28.588582 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-19898738-2d87-4237-88ec-84b4574a802a tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:28.596649 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-19898738-2d87-4237-88ec-84b4574a802a tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1575 microversion: 2.1 time: 0.222426 Apr 08 02:54:28.597211 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 380/785] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:28 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:29.613588 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4c061bbd-5da1-4529-9cff-7bae1bfb670b tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:29.614205 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4c061bbd-5da1-4529-9cff-7bae1bfb670b tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:29.621528 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4c061bbd-5da1-4529-9cff-7bae1bfb670b tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:29.621979 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4c061bbd-5da1-4529-9cff-7bae1bfb670b tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:29.622743 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4c061bbd-5da1-4529-9cff-7bae1bfb670b tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:29.623177 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4c061bbd-5da1-4529-9cff-7bae1bfb670b tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:29.692738 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f20afe3f-40e6-4960-90ef-648261f5b8e2 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:29.693271 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f20afe3f-40e6-4960-90ef-648261f5b8e2 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:29.701018 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f20afe3f-40e6-4960-90ef-648261f5b8e2 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:29.701468 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f20afe3f-40e6-4960-90ef-648261f5b8e2 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:29.702240 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f20afe3f-40e6-4960-90ef-648261f5b8e2 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:29.702673 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f20afe3f-40e6-4960-90ef-648261f5b8e2 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:29.751395 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-f20afe3f-40e6-4960-90ef-648261f5b8e2 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] HTTP exception thrown: Instance dc8070c3-de05-4d72-a6c7-8ec58bd750c5 could not be found. Apr 08 02:54:29.752042 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f20afe3f-40e6-4960-90ef-648261f5b8e2 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Returning 404 to user: Instance dc8070c3-de05-4d72-a6c7-8ec58bd750c5 could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:54:29.752851 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f20afe3f-40e6-4960-90ef-648261f5b8e2 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 404 len: 111 microversion: 2.1 time: 0.063955 Apr 08 02:54:29.753405 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 381/786] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:54:29 2022] DELETE /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:54:29.761895 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b143f155-dd62-4220-8eea-fd1b72575d0e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:29.762438 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b143f155-dd62-4220-8eea-fd1b72575d0e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: dc8070c3-de05-4d72-a6c7-8ec58bd750c5] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:29.769488 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b143f155-dd62-4220-8eea-fd1b72575d0e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:29.769936 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b143f155-dd62-4220-8eea-fd1b72575d0e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:29.770749 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b143f155-dd62-4220-8eea-fd1b72575d0e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:29.771191 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b143f155-dd62-4220-8eea-fd1b72575d0e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:29.821117 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-b143f155-dd62-4220-8eea-fd1b72575d0e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] HTTP exception thrown: Instance dc8070c3-de05-4d72-a6c7-8ec58bd750c5 could not be found. Apr 08 02:54:29.821957 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b143f155-dd62-4220-8eea-fd1b72575d0e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Returning 404 to user: Instance dc8070c3-de05-4d72-a6c7-8ec58bd750c5 could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:54:29.822778 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b143f155-dd62-4220-8eea-fd1b72575d0e tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5" status: 404 len: 111 microversion: 2.1 time: 0.065342 Apr 08 02:54:29.823563 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 382/787] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:29 2022] GET /compute/v2.1/servers/dc8070c3-de05-4d72-a6c7-8ec58bd750c5 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:54:29.826104 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4c061bbd-5da1-4529-9cff-7bae1bfb670b tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:29.834328 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-4c061bbd-5da1-4529-9cff-7bae1bfb670b tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1575 microversion: 2.1 time: 0.224429 Apr 08 02:54:29.834881 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 406/788] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:29 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:30.850926 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-58c720c0-c1ae-4b41-9ff6-b93e8d8d5772 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:30.851529 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-58c720c0-c1ae-4b41-9ff6-b93e8d8d5772 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:30.859205 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-58c720c0-c1ae-4b41-9ff6-b93e8d8d5772 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:30.859651 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-58c720c0-c1ae-4b41-9ff6-b93e8d8d5772 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:30.860433 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-58c720c0-c1ae-4b41-9ff6-b93e8d8d5772 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:30.860863 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-58c720c0-c1ae-4b41-9ff6-b93e8d8d5772 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:31.051029 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ce5cc515-b380-4262-a6e1-a476d1697ab1 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:31.051669 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ce5cc515-b380-4262-a6e1-a476d1697ab1 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:31.060717 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce5cc515-b380-4262-a6e1-a476d1697ab1 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:31.060867 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-58c720c0-c1ae-4b41-9ff6-b93e8d8d5772 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:31.061161 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce5cc515-b380-4262-a6e1-a476d1697ab1 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:31.061954 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce5cc515-b380-4262-a6e1-a476d1697ab1 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:31.062387 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce5cc515-b380-4262-a6e1-a476d1697ab1 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:31.068883 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-58c720c0-c1ae-4b41-9ff6-b93e8d8d5772 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1575 microversion: 2.1 time: 0.221632 Apr 08 02:54:31.069444 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 383/789] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:30 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:31.112993 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-ce5cc515-b380-4262-a6e1-a476d1697ab1 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] HTTP exception thrown: Instance ff7e510d-5c97-4291-930a-66cd4b8d6137 could not be found. Apr 08 02:54:31.113591 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ce5cc515-b380-4262-a6e1-a476d1697ab1 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Returning 404 to user: Instance ff7e510d-5c97-4291-930a-66cd4b8d6137 could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:54:31.114405 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ce5cc515-b380-4262-a6e1-a476d1697ab1 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 404 len: 111 microversion: 2.1 time: 0.067096 Apr 08 02:54:31.114948 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 407/790] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:54:31 2022] DELETE /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:54:31.123351 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-252f918c-5c2d-4a3d-a4cf-b11ededabd95 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:31.124015 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-252f918c-5c2d-4a3d-a4cf-b11ededabd95 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] [instance: ff7e510d-5c97-4291-930a-66cd4b8d6137] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:31.131145 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-252f918c-5c2d-4a3d-a4cf-b11ededabd95 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:31.131600 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-252f918c-5c2d-4a3d-a4cf-b11ededabd95 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:31.132398 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-252f918c-5c2d-4a3d-a4cf-b11ededabd95 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:31.132838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-252f918c-5c2d-4a3d-a4cf-b11ededabd95 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:31.182002 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-252f918c-5c2d-4a3d-a4cf-b11ededabd95 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] HTTP exception thrown: Instance ff7e510d-5c97-4291-930a-66cd4b8d6137 could not be found. Apr 08 02:54:31.182592 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-252f918c-5c2d-4a3d-a4cf-b11ededabd95 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] Returning 404 to user: Instance ff7e510d-5c97-4291-930a-66cd4b8d6137 could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:54:31.183403 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-252f918c-5c2d-4a3d-a4cf-b11ededabd95 tempest-AttachVolumeTestJSON-509538893 tempest-AttachVolumeTestJSON-509538893-project] 10.222.0.23 "GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137" status: 404 len: 111 microversion: 2.1 time: 0.063794 Apr 08 02:54:31.183919 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 384/791] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:31 2022] GET /compute/v2.1/servers/ff7e510d-5c97-4291-930a-66cd4b8d6137 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:54:32.085669 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5d0d41b2-6bf9-4a37-a61a-72814df9162f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:32.086324 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5d0d41b2-6bf9-4a37-a61a-72814df9162f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:54:32.094692 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5d0d41b2-6bf9-4a37-a61a-72814df9162f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:32.095147 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5d0d41b2-6bf9-4a37-a61a-72814df9162f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:32.096043 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5d0d41b2-6bf9-4a37-a61a-72814df9162f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:32.096482 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5d0d41b2-6bf9-4a37-a61a-72814df9162f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:32.370004 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5d0d41b2-6bf9-4a37-a61a-72814df9162f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:54:32.378196 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5d0d41b2-6bf9-4a37-a61a-72814df9162f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1562 microversion: 2.1 time: 0.296276 Apr 08 02:54:32.378755 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 408/792] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:32 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1562 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:34.681234 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-b4b105ff-0eb8-46f2-9837-7844f3cdd928 req-3812eaea-ec52-4ee8-817a-fd9e11d28bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c826480b-a813-4281-83a6-c743d8a84b9c", "name": "network-vif-plugged", "status": "completed", "tag": "105b6cec-7cb5-414f-809c-11a2bc5ec384"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:34.683788 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:34.683788 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:54:34.692833 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-b4b105ff-0eb8-46f2-9837-7844f3cdd928 req-3812eaea-ec52-4ee8-817a-fd9e11d28bdf service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:34.693282 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-b4b105ff-0eb8-46f2-9837-7844f3cdd928 req-3812eaea-ec52-4ee8-817a-fd9e11d28bdf service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:34.709725 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-b4b105ff-0eb8-46f2-9837-7844f3cdd928 req-3812eaea-ec52-4ee8-817a-fd9e11d28bdf service nova] Creating event network-vif-plugged:105b6cec-7cb5-414f-809c-11a2bc5ec384 for instance c826480b-a813-4281-83a6-c743d8a84b9c on hv-cinder-83705 Apr 08 02:54:34.715367 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-b4b105ff-0eb8-46f2-9837-7844f3cdd928 req-3812eaea-ec52-4ee8-817a-fd9e11d28bdf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038738 Apr 08 02:54:34.715749 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 385/793] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:15.688741 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b625f536-7ad9-4998-9c97-6c124e0e6676 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:15.689682 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b625f536-7ad9-4998-9c97-6c124e0e6676 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:15.697677 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b625f536-7ad9-4998-9c97-6c124e0e6676 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:15.698119 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b625f536-7ad9-4998-9c97-6c124e0e6676 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:15.698872 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b625f536-7ad9-4998-9c97-6c124e0e6676 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:15.699301 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b625f536-7ad9-4998-9c97-6c124e0e6676 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:15.764171 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b625f536-7ad9-4998-9c97-6c124e0e6676 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.079079 Apr 08 02:55:15.764730 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 409/794] 10.222.0.23 () {60 vars in 1342 bytes} [Fri Apr 8 02:55:15 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:15.859686 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d89896f1-55f0-4d07-849b-609506716e6a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:15.860899 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-d89896f1-55f0-4d07-849b-609506716e6a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:15.868469 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d89896f1-55f0-4d07-849b-609506716e6a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:15.868938 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d89896f1-55f0-4d07-849b-609506716e6a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:15.869710 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d89896f1-55f0-4d07-849b-609506716e6a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:15.870168 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d89896f1-55f0-4d07-849b-609506716e6a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:15.932765 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-d89896f1-55f0-4d07-849b-609506716e6a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Going to try to terminate instance {{(pid=101271) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:55:16.045947 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-d89896f1-55f0-4d07-849b-609506716e6a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "DELETE /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 204 len: 0 microversion: 2.20 time: 0.191608 Apr 08 02:55:16.046679 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 386/795] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Apr 8 02:55:15 2022] DELETE /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 08 02:55:16.056221 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d16d48f5-cb21-4077-8abd-3cdc3080795d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:16.057096 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d16d48f5-cb21-4077-8abd-3cdc3080795d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:16.064274 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d16d48f5-cb21-4077-8abd-3cdc3080795d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:16.064713 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d16d48f5-cb21-4077-8abd-3cdc3080795d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:16.065463 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d16d48f5-cb21-4077-8abd-3cdc3080795d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:16.065906 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d16d48f5-cb21-4077-8abd-3cdc3080795d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:16.268476 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d16d48f5-cb21-4077-8abd-3cdc3080795d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:16.276948 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d16d48f5-cb21-4077-8abd-3cdc3080795d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:16.278443 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d16d48f5-cb21-4077-8abd-3cdc3080795d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:16.279557 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d16d48f5-cb21-4077-8abd-3cdc3080795d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.228534 Apr 08 02:55:16.280145 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 410/796] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:55:16 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:55:17.298991 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fe212f87-d149-4ac9-837a-50dc2383c66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:17.299730 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-fe212f87-d149-4ac9-837a-50dc2383c66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:17.307839 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fe212f87-d149-4ac9-837a-50dc2383c66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:17.308315 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fe212f87-d149-4ac9-837a-50dc2383c66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:17.309084 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fe212f87-d149-4ac9-837a-50dc2383c66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:17.309520 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fe212f87-d149-4ac9-837a-50dc2383c66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:17.511351 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fe212f87-d149-4ac9-837a-50dc2383c66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:17.520108 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fe212f87-d149-4ac9-837a-50dc2383c66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:17.521624 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fe212f87-d149-4ac9-837a-50dc2383c66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:17.522827 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-fe212f87-d149-4ac9-837a-50dc2383c66e tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.227891 Apr 08 02:55:17.523626 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 387/797] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:55:17 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:55:18.544517 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-cc024139-3013-4903-a443-ff09678b088f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:18.545767 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-cc024139-3013-4903-a443-ff09678b088f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:18.555536 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cc024139-3013-4903-a443-ff09678b088f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:18.556301 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cc024139-3013-4903-a443-ff09678b088f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:18.557527 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cc024139-3013-4903-a443-ff09678b088f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:18.558111 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cc024139-3013-4903-a443-ff09678b088f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:18.771394 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cc024139-3013-4903-a443-ff09678b088f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:18.780752 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cc024139-3013-4903-a443-ff09678b088f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:18.782404 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cc024139-3013-4903-a443-ff09678b088f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:18.783654 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-cc024139-3013-4903-a443-ff09678b088f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1723 microversion: 2.20 time: 0.243868 Apr 08 02:55:18.784336 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 411/798] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:55:18 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:55:19.510817 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-ce403026-2f9a-4d69-b5fc-19c7480c907c req-a98f59c5-eef5-4e17-b2da-a92847ded1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66", "name": "network-vif-deleted", "tag": "b1b47b52-100c-4e18-8a4a-3d16d8561d14"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:55:19.512724 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:55:19.512724 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:55:19.525027 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-ce403026-2f9a-4d69-b5fc-19c7480c907c req-a98f59c5-eef5-4e17-b2da-a92847ded1f0 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:19.525687 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-ce403026-2f9a-4d69-b5fc-19c7480c907c req-a98f59c5-eef5-4e17-b2da-a92847ded1f0 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:19.545516 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-ce403026-2f9a-4d69-b5fc-19c7480c907c req-a98f59c5-eef5-4e17-b2da-a92847ded1f0 service nova] Creating event network-vif-deleted:b1b47b52-100c-4e18-8a4a-3d16d8561d14 for instance 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 on hv-cinder-83705 Apr 08 02:55:19.552834 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-ce403026-2f9a-4d69-b5fc-19c7480c907c req-a98f59c5-eef5-4e17-b2da-a92847ded1f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046941 Apr 08 02:55:19.557410 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 388/799] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:19.803749 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b6d381d3-fe43-42e4-8a1d-9d906882d82f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:19.804939 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b6d381d3-fe43-42e4-8a1d-9d906882d82f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:19.814683 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b6d381d3-fe43-42e4-8a1d-9d906882d82f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:19.815164 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b6d381d3-fe43-42e4-8a1d-9d906882d82f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:19.816116 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b6d381d3-fe43-42e4-8a1d-9d906882d82f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:19.816603 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b6d381d3-fe43-42e4-8a1d-9d906882d82f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:19.903088 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b6d381d3-fe43-42e4-8a1d-9d906882d82f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:19.903689 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b6d381d3-fe43-42e4-8a1d-9d906882d82f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:19.904277 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.objects.instance [None req-b6d381d3-fe43-42e4-8a1d-9d906882d82f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lazy-loading 'fault' on Instance uuid 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 {{(pid=101272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:55:19.960246 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b6d381d3-fe43-42e4-8a1d-9d906882d82f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:19.972284 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b6d381d3-fe43-42e4-8a1d-9d906882d82f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:19.974022 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b6d381d3-fe43-42e4-8a1d-9d906882d82f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8e3c70e491a4f0691f753c8e2b95e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688b5f689e3e41249484667a939fd5f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:19.975272 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b6d381d3-fe43-42e4-8a1d-9d906882d82f tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 200 len: 1372 microversion: 2.20 time: 0.175261 Apr 08 02:55:19.976993 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 412/800] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:55:19 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:55:20.997780 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-19ca7af5-dc73-4930-acc9-91fcccaccd5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:20.998496 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-19ca7af5-dc73-4930-acc9-91fcccaccd5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:21.007061 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-19ca7af5-dc73-4930-acc9-91fcccaccd5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:21.008192 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-19ca7af5-dc73-4930-acc9-91fcccaccd5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:21.009834 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-19ca7af5-dc73-4930-acc9-91fcccaccd5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:21.010247 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-19ca7af5-dc73-4930-acc9-91fcccaccd5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:21.077695 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-19ca7af5-dc73-4930-acc9-91fcccaccd5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] HTTP exception thrown: Instance 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 could not be found. Apr 08 02:55:21.078095 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-19ca7af5-dc73-4930-acc9-91fcccaccd5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Returning 404 to user: Instance 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:55:21.081019 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-19ca7af5-dc73-4930-acc9-91fcccaccd5d tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 404 len: 111 microversion: 2.20 time: 0.087750 Apr 08 02:55:21.081019 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 389/801] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:55:20 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 08 02:55:21.089130 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-aa5533a5-c266-4a1a-8d13-3bc0ec8bb256 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '.version_select at 0x7fbc380f9d30>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:21.109417 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-aa5533a5-c266-4a1a-8d13-3bc0ec8bb256 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712436184" status: 204 len: 0 microversion: 2.20 time: 0.023852 Apr 08 02:55:21.117274 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 413/802] 10.222.0.23 () {60 vars in 1261 bytes} [Fri Apr 8 02:55:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712436184 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 08 02:55:23.465809 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fb5a2460-cbc5-4627-a053-19b10910b68a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:23.467027 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-fb5a2460-cbc5-4627-a053-19b10910b68a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:23.474753 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb5a2460-cbc5-4627-a053-19b10910b68a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:23.475615 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb5a2460-cbc5-4627-a053-19b10910b68a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:23.476715 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb5a2460-cbc5-4627-a053-19b10910b68a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:23.477376 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb5a2460-cbc5-4627-a053-19b10910b68a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:23.532725 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-fb5a2460-cbc5-4627-a053-19b10910b68a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] HTTP exception thrown: Instance 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 could not be found. Apr 08 02:55:23.533419 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fb5a2460-cbc5-4627-a053-19b10910b68a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Returning 404 to user: Instance 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:55:23.534327 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-fb5a2460-cbc5-4627-a053-19b10910b68a tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "DELETE /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 404 len: 111 microversion: 2.20 time: 0.072272 Apr 08 02:55:23.535107 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 390/803] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Apr 8 02:55:23 2022] DELETE /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 02:55:23.543813 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d4acb480-4709-4c39-b3ce-792b3886ce1c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:23.545651 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d4acb480-4709-4c39-b3ce-792b3886ce1c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:23.555378 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d4acb480-4709-4c39-b3ce-792b3886ce1c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:23.555831 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d4acb480-4709-4c39-b3ce-792b3886ce1c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:23.556661 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d4acb480-4709-4c39-b3ce-792b3886ce1c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:23.557336 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d4acb480-4709-4c39-b3ce-792b3886ce1c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:23.614797 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-d4acb480-4709-4c39-b3ce-792b3886ce1c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] HTTP exception thrown: Instance 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 could not be found. Apr 08 02:55:23.615502 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d4acb480-4709-4c39-b3ce-792b3886ce1c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Returning 404 to user: Instance 528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:55:23.616597 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d4acb480-4709-4c39-b3ce-792b3886ce1c tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66" status: 404 len: 111 microversion: 2.20 time: 0.076495 Apr 08 02:55:23.618008 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 414/804] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:55:23 2022] GET /compute/v2.1/servers/528bbb28-cc8d-4ecf-acb2-bb4c0c3a4a66 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 02:55:24.874063 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e895d715-1d14-4cc2-b82d-869853ef4251 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:24.875274 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e895d715-1d14-4cc2-b82d-869853ef4251 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:24.883460 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e895d715-1d14-4cc2-b82d-869853ef4251 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:24.884049 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e895d715-1d14-4cc2-b82d-869853ef4251 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:24.884898 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e895d715-1d14-4cc2-b82d-869853ef4251 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:24.885502 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e895d715-1d14-4cc2-b82d-869853ef4251 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:24.936820 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-e895d715-1d14-4cc2-b82d-869853ef4251 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] HTTP exception thrown: Instance 89a1344c-2d91-4224-ab68-1898d4aa8b0f could not be found. Apr 08 02:55:24.937723 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e895d715-1d14-4cc2-b82d-869853ef4251 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Returning 404 to user: Instance 89a1344c-2d91-4224-ab68-1898d4aa8b0f could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:55:24.938702 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e895d715-1d14-4cc2-b82d-869853ef4251 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "DELETE /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 404 len: 111 microversion: 2.20 time: 0.068777 Apr 08 02:55:24.939723 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 391/805] 10.222.0.23 () {60 vars in 1279 bytes} [Fri Apr 8 02:55:24 2022] DELETE /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 02:55:24.947513 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c9ab3fac-d504-444c-a880-c823f2f9d803 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:24.949169 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c9ab3fac-d504-444c-a880-c823f2f9d803 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] [instance: 89a1344c-2d91-4224-ab68-1898d4aa8b0f] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:24.957060 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c9ab3fac-d504-444c-a880-c823f2f9d803 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:24.957520 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c9ab3fac-d504-444c-a880-c823f2f9d803 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:24.958490 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c9ab3fac-d504-444c-a880-c823f2f9d803 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:24.958932 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c9ab3fac-d504-444c-a880-c823f2f9d803 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:25.010226 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-c9ab3fac-d504-444c-a880-c823f2f9d803 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] HTTP exception thrown: Instance 89a1344c-2d91-4224-ab68-1898d4aa8b0f could not be found. Apr 08 02:55:25.010848 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c9ab3fac-d504-444c-a880-c823f2f9d803 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] Returning 404 to user: Instance 89a1344c-2d91-4224-ab68-1898d4aa8b0f could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:55:25.011687 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c9ab3fac-d504-444c-a880-c823f2f9d803 tempest-AttachVolumeShelveTestJSON-915151659 tempest-AttachVolumeShelveTestJSON-915151659-project] 10.222.0.23 "GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f" status: 404 len: 111 microversion: 2.20 time: 0.068033 Apr 08 02:55:25.012458 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 415/806] 10.222.0.23 () {60 vars in 1276 bytes} [Fri Apr 8 02:55:24 2022] GET /compute/v2.1/servers/89a1344c-2d91-4224-ab68-1898d4aa8b0f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 08 02:55:34.291765 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-0d230659-5433-4b27-ba7e-ff01497766fd tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] Action: 'create', calling method: .version_select at 0x7fbc3848c3a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-644285306", "metadata": {"Type": "work"}}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:55:34.293507 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-0d230659-5433-4b27-ba7e-ff01497766fd tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:55:34.294643 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-0d230659-5433-4b27-ba7e-ff01497766fd tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.175286 Apr 08 02:55:34.295201 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 392/807] 10.222.0.23 () {60 vars in 1155 bytes} [Fri Apr 8 02:55:34 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 02:55:34.305695 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-034bcdc6-910d-4abc-8035-0d653984911c tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] Action: 'create', calling method: .version_select at 0x7fbc387cb3a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-516859765", "metadata": {"Type": "work"}}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:55:34.307421 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-034bcdc6-910d-4abc-8035-0d653984911c tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:55:34.308316 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-034bcdc6-910d-4abc-8035-0d653984911c tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007350 Apr 08 02:55:34.308887 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 416/808] 10.222.0.23 () {60 vars in 1155 bytes} [Fri Apr 8 02:55:34 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 08 02:55:34.318259 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5097ba69-36d3-466d-ae6a-15b5f060bb12 tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] Action: 'create', calling method: .version_select at 0x7fbc387573a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-300930342", "metadata": {"Type": "work"}}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:55:34.319497 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5097ba69-36d3-466d-ae6a-15b5f060bb12 tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:55:34.320653 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-5097ba69-36d3-466d-ae6a-15b5f060bb12 tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006312 Apr 08 02:55:34.325123 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 393/809] 10.222.0.23 () {60 vars in 1155 bytes} [Fri Apr 8 02:55:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 02:55:34.340155 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-7f68c53a-a727-4bb6-9ede-4b54ef88a69f tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] Calling method '.version_select at 0x7fbc380f9f70>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:34.419180 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-7f68c53a-a727-4bb6-9ede-4b54ef88a69f tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] HTTP exception thrown: Volume tempest-invalid-528769691 could not be found. Apr 08 02:55:34.420589 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-7f68c53a-a727-4bb6-9ede-4b54ef88a69f tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] Returning 404 to user: Volume tempest-invalid-528769691 could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:55:34.422198 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-7f68c53a-a727-4bb6-9ede-4b54ef88a69f tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-528769691" status: 404 len: 98 microversion: 2.1 time: 0.095293 Apr 08 02:55:34.423284 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 417/810] 10.222.0.23 () {58 vars in 1214 bytes} [Fri Apr 8 02:55:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-528769691 => generated 98 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 08 02:55:34.434232 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ab174c2c-e4ff-471f-8d51-7e851b6b3746 tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004138 Apr 08 02:55:34.434748 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 394/811] 10.222.0.23 () {58 vars in 1139 bytes} [Fri Apr 8 02:55:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 08 02:55:34.448682 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-331e9e9b-fe09-4edc-8df0-f932d8474063 tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003780 Apr 08 02:55:34.449487 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 418/812] 10.222.0.23 () {58 vars in 1136 bytes} [Fri Apr 8 02:55:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 08 02:55:34.459651 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ea18f445-b1dc-4e4c-b3e5-5eb1e9165790 tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] Calling method '.version_select at 0x7fbc38694f70>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:34.544915 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-ea18f445-b1dc-4e4c-b3e5-5eb1e9165790 tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] HTTP exception thrown: Volume 2c589236-2004-4256-a987-898588ce0893 could not be found. Apr 08 02:55:34.545510 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ea18f445-b1dc-4e4c-b3e5-5eb1e9165790 tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] Returning 404 to user: Volume 2c589236-2004-4256-a987-898588ce0893 could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:55:34.546327 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ea18f445-b1dc-4e4c-b3e5-5eb1e9165790 tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/2c589236-2004-4256-a987-898588ce0893" status: 404 len: 109 microversion: 2.1 time: 0.091613 Apr 08 02:55:34.546860 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 395/813] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Apr 8 02:55:34 2022] DELETE /compute/v2.1/os-volumes/2c589236-2004-4256-a987-898588ce0893 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:55:34.558440 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2ea1e1b8-8fa3-48f8-a9d5-e83a00fd4c66 tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] Calling method '.version_select at 0x7fbc387cbee0>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:34.632711 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-2ea1e1b8-8fa3-48f8-a9d5-e83a00fd4c66 tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] HTTP exception thrown: Volume 0d7a3b2f-1289-4d7d-89ba-f097c11c1f8e could not be found. Apr 08 02:55:34.633316 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2ea1e1b8-8fa3-48f8-a9d5-e83a00fd4c66 tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] Returning 404 to user: Volume 0d7a3b2f-1289-4d7d-89ba-f097c11c1f8e could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:55:34.634169 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2ea1e1b8-8fa3-48f8-a9d5-e83a00fd4c66 tempest-VolumesNegativeTest-1166553444 tempest-VolumesNegativeTest-1166553444-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/0d7a3b2f-1289-4d7d-89ba-f097c11c1f8e" status: 404 len: 109 microversion: 2.1 time: 0.080844 Apr 08 02:55:34.634891 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 419/814] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Apr 8 02:55:34 2022] GET /compute/v2.1/os-volumes/0d7a3b2f-1289-4d7d-89ba-f097c11c1f8e => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:55:39.765842 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-7a70a7bf-0140-4b5b-823e-97f4295c3845 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:39.766922 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-7a70a7bf-0140-4b5b-823e-97f4295c3845 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:39.782803 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7a70a7bf-0140-4b5b-823e-97f4295c3845 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:39.783501 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7a70a7bf-0140-4b5b-823e-97f4295c3845 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:39.784636 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7a70a7bf-0140-4b5b-823e-97f4295c3845 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:39.785236 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7a70a7bf-0140-4b5b-823e-97f4295c3845 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:39.899391 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-7a70a7bf-0140-4b5b-823e-97f4295c3845 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/ips" status: 200 len: 150 microversion: 2.1 time: 0.137323 Apr 08 02:55:39.905694 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 396/815] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Apr 8 02:55:39 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/ips => generated 150 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:41.654709 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2e18f378-afe3-4351-ba81-5a70385c63ba tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cb16c2c-f299-4416-9ab9-3d32a5bb3bf7"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:55:41.656427 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2e18f378-afe3-4351-ba81-5a70385c63ba tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:41.663981 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2e18f378-afe3-4351-ba81-5a70385c63ba tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:41.664683 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2e18f378-afe3-4351-ba81-5a70385c63ba tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:41.665653 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2e18f378-afe3-4351-ba81-5a70385c63ba tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:41.666255 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2e18f378-afe3-4351-ba81-5a70385c63ba tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:42.095918 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2e18f378-afe3-4351-ba81-5a70385c63ba tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "POST /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.445521 Apr 08 02:55:42.096770 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 420/816] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Apr 8 02:55:41 2022] POST /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments => generated 194 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:46.564960 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-dda005b1-287a-4212-b615-2729e25a2003 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Action: 'create', calling method: .version_select at 0x7fbc386065e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-45975164"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:55:46.588500 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-dda005b1-287a-4212-b615-2729e25a2003 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Getting quotas for project db379f877ebf4bda8bcef28d03d0e3bb. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:55:46.597002 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-dda005b1-287a-4212-b615-2729e25a2003 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Getting quotas for user 38c39d689d5b4a848bbab29270c58318 and project db379f877ebf4bda8bcef28d03d0e3bb. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:55:46.924674 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-dda005b1-287a-4212-b615-2729e25a2003 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Getting quotas for project db379f877ebf4bda8bcef28d03d0e3bb. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:55:46.929342 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-dda005b1-287a-4212-b615-2729e25a2003 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Getting quotas for user 38c39d689d5b4a848bbab29270c58318 and project db379f877ebf4bda8bcef28d03d0e3bb. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:55:46.942865 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-dda005b1-287a-4212-b615-2729e25a2003 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.381702 Apr 08 02:55:46.943468 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 397/817] 10.222.0.23 () {60 vars in 1157 bytes} [Fri Apr 8 02:55:46 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:47.059155 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-69c1ded4-2ebb-478f-8f1b-13068fa73334 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1635496195", "imageRef": "66276782-cb83-4841-b2ce-b5496501ab6b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-45975164", "networks": [{"uuid": "470b3774-e0c3-4f99-a636-71fb4a8c79b9"}]}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:55:47.122402 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.network.neutron [None req-69c1ded4-2ebb-478f-8f1b-13068fa73334 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] validate_networks() for [('470b3774-e0c3-4f99-a636-71fb4a8c79b9', None, None, None)] {{(pid=101272) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:55:47.812153 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-69c1ded4-2ebb-478f-8f1b-13068fa73334 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Flavor limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:55:47.812574 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-69c1ded4-2ebb-478f-8f1b-13068fa73334 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Image limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:55:47.813044 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-69c1ded4-2ebb-478f-8f1b-13068fa73334 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Flavor pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:55:47.813452 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-69c1ded4-2ebb-478f-8f1b-13068fa73334 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Image pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:55:47.813855 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-69c1ded4-2ebb-478f-8f1b-13068fa73334 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:55:47.822590 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-69c1ded4-2ebb-478f-8f1b-13068fa73334 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:47.823028 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-69c1ded4-2ebb-478f-8f1b-13068fa73334 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:47.823852 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-69c1ded4-2ebb-478f-8f1b-13068fa73334 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:47.824386 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-69c1ded4-2ebb-478f-8f1b-13068fa73334 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:47.841653 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-69c1ded4-2ebb-478f-8f1b-13068fa73334 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Getting quotas for project db379f877ebf4bda8bcef28d03d0e3bb. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:55:47.846861 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-69c1ded4-2ebb-478f-8f1b-13068fa73334 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Getting quotas for user 38c39d689d5b4a848bbab29270c58318 and project db379f877ebf4bda8bcef28d03d0e3bb. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:55:47.858093 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-69c1ded4-2ebb-478f-8f1b-13068fa73334 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Going to run 1 instances... {{(pid=101272) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:55:47.861172 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-69c1ded4-2ebb-478f-8f1b-13068fa73334 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66276782-cb83-4841-b2ce-b5496501ab6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:55:47.910779 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-69c1ded4-2ebb-478f-8f1b-13068fa73334 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857225 Apr 08 02:55:47.911986 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 421/818] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:55:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:55:47.922572 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-3c30bf96-198b-4f12-9bb9-4b01e00013b3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:47.924089 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-3c30bf96-198b-4f12-9bb9-4b01e00013b3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:48.002189 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-3c30bf96-198b-4f12-9bb9-4b01e00013b3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:48.011261 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-3c30bf96-198b-4f12-9bb9-4b01e00013b3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1257 microversion: 2.1 time: 0.092571 Apr 08 02:55:48.012435 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 398/819] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:47 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1257 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:49.028346 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9a78b7e5-e6b9-4ccd-be4f-1980b56f5d6c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:49.029086 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9a78b7e5-e6b9-4ccd-be4f-1980b56f5d6c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:49.036738 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9a78b7e5-e6b9-4ccd-be4f-1980b56f5d6c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:49.037186 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9a78b7e5-e6b9-4ccd-be4f-1980b56f5d6c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:49.038502 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9a78b7e5-e6b9-4ccd-be4f-1980b56f5d6c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:49.038941 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9a78b7e5-e6b9-4ccd-be4f-1980b56f5d6c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:49.330562 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9a78b7e5-e6b9-4ccd-be4f-1980b56f5d6c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:49.341920 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9a78b7e5-e6b9-4ccd-be4f-1980b56f5d6c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1327 microversion: 2.1 time: 0.317209 Apr 08 02:55:49.342511 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 422/820] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:49 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1327 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:50.359587 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-0eefc63f-a631-4e51-8c36-c427e2645ef2 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:50.360612 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-0eefc63f-a631-4e51-8c36-c427e2645ef2 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:50.376476 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0eefc63f-a631-4e51-8c36-c427e2645ef2 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:50.377897 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0eefc63f-a631-4e51-8c36-c427e2645ef2 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:50.379524 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0eefc63f-a631-4e51-8c36-c427e2645ef2 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:50.381836 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0eefc63f-a631-4e51-8c36-c427e2645ef2 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:50.590515 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4222d24a-216f-4070-94b7-baf08766bf74 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:50.592182 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4222d24a-216f-4070-94b7-baf08766bf74 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:50.606338 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4222d24a-216f-4070-94b7-baf08766bf74 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:50.608457 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4222d24a-216f-4070-94b7-baf08766bf74 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:50.612102 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4222d24a-216f-4070-94b7-baf08766bf74 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:50.612791 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4222d24a-216f-4070-94b7-baf08766bf74 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:50.937782 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0eefc63f-a631-4e51-8c36-c427e2645ef2 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:50.950096 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.objects.instance [None req-4222d24a-216f-4070-94b7-baf08766bf74 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lazy-loading 'services' on Instance uuid 7cfe12a9-7278-44ab-b795-c7b012fdbe6e {{(pid=101272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:55:50.956404 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-0eefc63f-a631-4e51-8c36-c427e2645ef2 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1357 microversion: 2.1 time: 0.598184 Apr 08 02:55:50.958896 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 399/821] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:50 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1357 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:51.135066 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-4222d24a-216f-4070-94b7-baf08766bf74 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments/0cb16c2c-f299-4416-9ab9-3d32a5bb3bf7" status: 202 len: 0 microversion: 2.1 time: 0.548837 Apr 08 02:55:51.136148 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 423/822] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Apr 8 02:55:50 2022] DELETE /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments/0cb16c2c-f299-4416-9ab9-3d32a5bb3bf7 => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:55:51.147647 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fafbce4f-b7d4-4a70-beda-5b0a9acd377b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:51.149880 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-fafbce4f-b7d4-4a70-beda-5b0a9acd377b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:51.158810 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fafbce4f-b7d4-4a70-beda-5b0a9acd377b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:51.159204 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fafbce4f-b7d4-4a70-beda-5b0a9acd377b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:51.160042 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fafbce4f-b7d4-4a70-beda-5b0a9acd377b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:51.160476 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fafbce4f-b7d4-4a70-beda-5b0a9acd377b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:51.235284 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-fafbce4f-b7d4-4a70-beda-5b0a9acd377b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093460 Apr 08 02:55:51.236255 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 400/823] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:55:51 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:55:51.973728 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-11f90951-82fb-4fdf-bafb-ea3b956cc4c7 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:51.974422 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-11f90951-82fb-4fdf-bafb-ea3b956cc4c7 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:51.983139 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-11f90951-82fb-4fdf-bafb-ea3b956cc4c7 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:51.983591 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-11f90951-82fb-4fdf-bafb-ea3b956cc4c7 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:51.984814 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-11f90951-82fb-4fdf-bafb-ea3b956cc4c7 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:51.985255 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-11f90951-82fb-4fdf-bafb-ea3b956cc4c7 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:52.232137 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-11f90951-82fb-4fdf-bafb-ea3b956cc4c7 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:52.243562 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-11f90951-82fb-4fdf-bafb-ea3b956cc4c7 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1357 microversion: 2.1 time: 0.271551 Apr 08 02:55:52.253723 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 424/824] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:51 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1357 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:52.257046 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-19b7824c-d615-4570-b2d7-c1423bac9712 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:52.257984 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-19b7824c-d615-4570-b2d7-c1423bac9712 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:52.265395 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-19b7824c-d615-4570-b2d7-c1423bac9712 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:52.265844 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-19b7824c-d615-4570-b2d7-c1423bac9712 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:52.266622 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-19b7824c-d615-4570-b2d7-c1423bac9712 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:52.267233 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-19b7824c-d615-4570-b2d7-c1423bac9712 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:52.337498 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-19b7824c-d615-4570-b2d7-c1423bac9712 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093162 Apr 08 02:55:52.338068 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 401/825] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:55:52 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:55:53.262318 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-32f3e0de-c3da-4a62-a5c3-18cc4bde26cd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:53.263002 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-32f3e0de-c3da-4a62-a5c3-18cc4bde26cd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:53.270457 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-32f3e0de-c3da-4a62-a5c3-18cc4bde26cd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:53.271001 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-32f3e0de-c3da-4a62-a5c3-18cc4bde26cd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:53.272032 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-32f3e0de-c3da-4a62-a5c3-18cc4bde26cd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:53.273216 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-32f3e0de-c3da-4a62-a5c3-18cc4bde26cd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:53.350689 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1ce7d601-d1a6-41a7-9971-3823a8fcdb9b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:53.352423 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1ce7d601-d1a6-41a7-9971-3823a8fcdb9b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:53.363608 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1ce7d601-d1a6-41a7-9971-3823a8fcdb9b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:53.364394 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1ce7d601-d1a6-41a7-9971-3823a8fcdb9b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:53.365760 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1ce7d601-d1a6-41a7-9971-3823a8fcdb9b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:53.366367 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1ce7d601-d1a6-41a7-9971-3823a8fcdb9b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:53.485413 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1ce7d601-d1a6-41a7-9971-3823a8fcdb9b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138422 Apr 08 02:55:53.491223 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 402/826] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:55:53 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:55:53.568545 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-32f3e0de-c3da-4a62-a5c3-18cc4bde26cd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:53.578148 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-32f3e0de-c3da-4a62-a5c3-18cc4bde26cd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1357 microversion: 2.1 time: 0.321280 Apr 08 02:55:53.578724 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 425/827] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:53 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1357 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:54.500685 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8e583cc7-7a3e-4347-a02b-2264e2932231 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:54.502277 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-8e583cc7-7a3e-4347-a02b-2264e2932231 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:54.520394 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8e583cc7-7a3e-4347-a02b-2264e2932231 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:54.520847 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8e583cc7-7a3e-4347-a02b-2264e2932231 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:54.521693 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8e583cc7-7a3e-4347-a02b-2264e2932231 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:54.522175 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8e583cc7-7a3e-4347-a02b-2264e2932231 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:54.598490 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5b7d8912-ea43-4acf-8655-5d4e06a68329 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:54.599128 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5b7d8912-ea43-4acf-8655-5d4e06a68329 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:54.607527 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5b7d8912-ea43-4acf-8655-5d4e06a68329 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:54.608358 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5b7d8912-ea43-4acf-8655-5d4e06a68329 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:54.609330 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5b7d8912-ea43-4acf-8655-5d4e06a68329 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:54.609996 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5b7d8912-ea43-4acf-8655-5d4e06a68329 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:54.610597 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8e583cc7-7a3e-4347-a02b-2264e2932231 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116163 Apr 08 02:55:54.615190 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 403/828] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:55:54 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:54.865719 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5b7d8912-ea43-4acf-8655-5d4e06a68329 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:54.884101 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5b7d8912-ea43-4acf-8655-5d4e06a68329 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1357 microversion: 2.1 time: 0.290826 Apr 08 02:55:54.885069 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 426/829] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:54 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1357 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:55:55.626144 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-56f6ea4c-2303-4650-bab4-b9fcc8f0c8b7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:55.626977 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-56f6ea4c-2303-4650-bab4-b9fcc8f0c8b7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:55.639463 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-56f6ea4c-2303-4650-bab4-b9fcc8f0c8b7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:55.639919 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-56f6ea4c-2303-4650-bab4-b9fcc8f0c8b7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:55.640726 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-56f6ea4c-2303-4650-bab4-b9fcc8f0c8b7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:55.641220 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-56f6ea4c-2303-4650-bab4-b9fcc8f0c8b7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:55.731536 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-56f6ea4c-2303-4650-bab4-b9fcc8f0c8b7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109564 Apr 08 02:55:55.732677 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 404/830] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:55:55 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:55.901452 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-eb41fdab-3ccf-4c94-9b2e-f6d9b0bf2413 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:55.902160 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-eb41fdab-3ccf-4c94-9b2e-f6d9b0bf2413 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:55.910566 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-eb41fdab-3ccf-4c94-9b2e-f6d9b0bf2413 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:55.911017 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-eb41fdab-3ccf-4c94-9b2e-f6d9b0bf2413 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:55.911961 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-eb41fdab-3ccf-4c94-9b2e-f6d9b0bf2413 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:55.912798 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-eb41fdab-3ccf-4c94-9b2e-f6d9b0bf2413 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:56.205732 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-eb41fdab-3ccf-4c94-9b2e-f6d9b0bf2413 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:56.216187 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-eb41fdab-3ccf-4c94-9b2e-f6d9b0bf2413 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1357 microversion: 2.1 time: 0.319091 Apr 08 02:55:56.226623 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 427/831] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:55 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1357 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:56.744447 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2ce9cbe0-367a-4fc2-ab7f-a32bd628557b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:56.745364 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2ce9cbe0-367a-4fc2-ab7f-a32bd628557b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:56.752802 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2ce9cbe0-367a-4fc2-ab7f-a32bd628557b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:56.753245 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2ce9cbe0-367a-4fc2-ab7f-a32bd628557b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:56.754008 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2ce9cbe0-367a-4fc2-ab7f-a32bd628557b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:56.754438 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2ce9cbe0-367a-4fc2-ab7f-a32bd628557b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:56.821624 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2ce9cbe0-367a-4fc2-ab7f-a32bd628557b tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081657 Apr 08 02:55:56.822093 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 405/832] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:55:56 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:57.234121 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9ddb75ef-3f9d-4e55-a53b-babdbc218383 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:57.234767 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9ddb75ef-3f9d-4e55-a53b-babdbc218383 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:57.242227 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9ddb75ef-3f9d-4e55-a53b-babdbc218383 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:57.242764 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9ddb75ef-3f9d-4e55-a53b-babdbc218383 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:57.243763 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9ddb75ef-3f9d-4e55-a53b-babdbc218383 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:57.244284 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9ddb75ef-3f9d-4e55-a53b-babdbc218383 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:57.496336 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9ddb75ef-3f9d-4e55-a53b-babdbc218383 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:57.505593 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9ddb75ef-3f9d-4e55-a53b-babdbc218383 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1357 microversion: 2.1 time: 0.275461 Apr 08 02:55:57.506142 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 428/833] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:57 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1357 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:55:57.832644 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-0af3290f-3b30-4c34-87c1-83ed0b103967 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:57.833745 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-0af3290f-3b30-4c34-87c1-83ed0b103967 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:57.841910 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0af3290f-3b30-4c34-87c1-83ed0b103967 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:57.842358 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0af3290f-3b30-4c34-87c1-83ed0b103967 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:57.843198 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0af3290f-3b30-4c34-87c1-83ed0b103967 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:57.843640 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0af3290f-3b30-4c34-87c1-83ed0b103967 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:57.924969 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-0af3290f-3b30-4c34-87c1-83ed0b103967 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096056 Apr 08 02:55:57.925542 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 406/834] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:55:57 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:58.524358 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-49f4d6b4-ccde-4a37-ba7c-b7b04e6f6010 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:58.525011 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-49f4d6b4-ccde-4a37-ba7c-b7b04e6f6010 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:58.533002 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-49f4d6b4-ccde-4a37-ba7c-b7b04e6f6010 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:58.533475 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-49f4d6b4-ccde-4a37-ba7c-b7b04e6f6010 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:58.534232 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-49f4d6b4-ccde-4a37-ba7c-b7b04e6f6010 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:58.534677 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-49f4d6b4-ccde-4a37-ba7c-b7b04e6f6010 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:58.730415 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-49f4d6b4-ccde-4a37-ba7c-b7b04e6f6010 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:58.738486 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-49f4d6b4-ccde-4a37-ba7c-b7b04e6f6010 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1357 microversion: 2.1 time: 0.217919 Apr 08 02:55:58.739046 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 429/835] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:58 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:58.936878 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8b9b5f96-3a23-4522-a65f-e9b089764191 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:58.937937 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-8b9b5f96-3a23-4522-a65f-e9b089764191 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:58.944927 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8b9b5f96-3a23-4522-a65f-e9b089764191 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:58.945371 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8b9b5f96-3a23-4522-a65f-e9b089764191 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:58.946123 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8b9b5f96-3a23-4522-a65f-e9b089764191 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:58.946551 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8b9b5f96-3a23-4522-a65f-e9b089764191 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:59.014017 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8b9b5f96-3a23-4522-a65f-e9b089764191 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081679 Apr 08 02:55:59.014589 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 407/836] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:55:58 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:59.754342 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9bdfeeec-7d4d-4a92-9a1e-984b8fb21b58 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:59.755057 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9bdfeeec-7d4d-4a92-9a1e-984b8fb21b58 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:55:59.762412 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9bdfeeec-7d4d-4a92-9a1e-984b8fb21b58 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:59.762927 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9bdfeeec-7d4d-4a92-9a1e-984b8fb21b58 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:59.763689 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9bdfeeec-7d4d-4a92-9a1e-984b8fb21b58 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:59.764151 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9bdfeeec-7d4d-4a92-9a1e-984b8fb21b58 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:59.976996 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9bdfeeec-7d4d-4a92-9a1e-984b8fb21b58 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:55:59.985638 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9bdfeeec-7d4d-4a92-9a1e-984b8fb21b58 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1357 microversion: 2.1 time: 0.234956 Apr 08 02:55:59.986191 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 430/837] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:59 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:00.025957 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d3d8220d-8439-4b83-bfa8-9c62dbcf9af0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:00.027035 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-d3d8220d-8439-4b83-bfa8-9c62dbcf9af0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:00.034144 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d3d8220d-8439-4b83-bfa8-9c62dbcf9af0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:00.034592 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d3d8220d-8439-4b83-bfa8-9c62dbcf9af0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:00.035354 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d3d8220d-8439-4b83-bfa8-9c62dbcf9af0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:00.035788 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d3d8220d-8439-4b83-bfa8-9c62dbcf9af0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:00.102033 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-d3d8220d-8439-4b83-bfa8-9c62dbcf9af0 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080212 Apr 08 02:56:00.102586 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 408/838] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:56:00 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:01.001574 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-fe943831-689f-41b9-b1b9-af7d0ef0f579 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:01.002189 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-fe943831-689f-41b9-b1b9-af7d0ef0f579 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:01.011844 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fe943831-689f-41b9-b1b9-af7d0ef0f579 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:01.012836 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fe943831-689f-41b9-b1b9-af7d0ef0f579 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:01.013880 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fe943831-689f-41b9-b1b9-af7d0ef0f579 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:01.014418 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fe943831-689f-41b9-b1b9-af7d0ef0f579 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:01.114399 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8a316202-444f-414e-a9ee-ea90240b02ce tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:01.115687 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-8a316202-444f-414e-a9ee-ea90240b02ce tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:01.124827 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8a316202-444f-414e-a9ee-ea90240b02ce tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:01.125736 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8a316202-444f-414e-a9ee-ea90240b02ce tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:01.126802 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8a316202-444f-414e-a9ee-ea90240b02ce tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:01.127719 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8a316202-444f-414e-a9ee-ea90240b02ce tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:01.235666 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8a316202-444f-414e-a9ee-ea90240b02ce tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125328 Apr 08 02:56:01.236917 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 409/839] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:56:01 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:01.415915 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-fe943831-689f-41b9-b1b9-af7d0ef0f579 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:01.430596 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-fe943831-689f-41b9-b1b9-af7d0ef0f579 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1357 microversion: 2.1 time: 0.432538 Apr 08 02:56:01.431797 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 431/840] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:00 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1357 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:01.969401 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-7586abc8-89ab-4599-a010-30b68119516c req-0d33bdf4-b69d-4a18-98c3-87230c3d35e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeb2b2fc-3410-4860-a03b-cab8c080197c", "tag": "c585c168-7e51-4ca1-8f45-2f19dde4b67a"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:01.971486 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:56:01.971486 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:56:01.981575 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-7586abc8-89ab-4599-a010-30b68119516c req-0d33bdf4-b69d-4a18-98c3-87230c3d35e9 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:01.982106 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-7586abc8-89ab-4599-a010-30b68119516c req-0d33bdf4-b69d-4a18-98c3-87230c3d35e9 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:02.000510 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-7586abc8-89ab-4599-a010-30b68119516c req-0d33bdf4-b69d-4a18-98c3-87230c3d35e9 service nova] Creating event network-changed:c585c168-7e51-4ca1-8f45-2f19dde4b67a for instance aeb2b2fc-3410-4860-a03b-cab8c080197c on hv-cinder-83705 Apr 08 02:56:02.006345 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-7586abc8-89ab-4599-a010-30b68119516c req-0d33bdf4-b69d-4a18-98c3-87230c3d35e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223995 Apr 08 02:56:02.008040 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 410/841] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:02.246754 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2c986c91-ebf8-45d2-a53b-1abac65dbc38 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:02.248360 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2c986c91-ebf8-45d2-a53b-1abac65dbc38 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:02.255893 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2c986c91-ebf8-45d2-a53b-1abac65dbc38 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:02.256652 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2c986c91-ebf8-45d2-a53b-1abac65dbc38 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:02.257676 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2c986c91-ebf8-45d2-a53b-1abac65dbc38 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:02.258317 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2c986c91-ebf8-45d2-a53b-1abac65dbc38 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:02.336036 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2c986c91-ebf8-45d2-a53b-1abac65dbc38 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093186 Apr 08 02:56:02.341010 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 432/842] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:56:02 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:56:02.449404 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f38b0ed8-5b80-43f7-8b82-5bd7e02ef0a8 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:02.450882 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-373b861f-5130-45fe-a155-11a9caf0c46d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:02.451502 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-373b861f-5130-45fe-a155-11a9caf0c46d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:02.451782 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f38b0ed8-5b80-43f7-8b82-5bd7e02ef0a8 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:02.459585 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f38b0ed8-5b80-43f7-8b82-5bd7e02ef0a8 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:02.460832 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f38b0ed8-5b80-43f7-8b82-5bd7e02ef0a8 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:02.461929 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f38b0ed8-5b80-43f7-8b82-5bd7e02ef0a8 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:02.462619 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f38b0ed8-5b80-43f7-8b82-5bd7e02ef0a8 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:02.472358 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-373b861f-5130-45fe-a155-11a9caf0c46d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:02.472822 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-373b861f-5130-45fe-a155-11a9caf0c46d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:02.473616 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-373b861f-5130-45fe-a155-11a9caf0c46d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:02.474061 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-373b861f-5130-45fe-a155-11a9caf0c46d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:02.578405 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-373b861f-5130-45fe-a155-11a9caf0c46d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Going to try to terminate instance {{(pid=101271) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:56:02.805860 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-373b861f-5130-45fe-a155-11a9caf0c46d tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 204 len: 0 microversion: 2.1 time: 0.361707 Apr 08 02:56:02.806978 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 411/843] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:56:02 2022] DELETE /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:56:02.820674 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-17005812-0f99-401e-8840-53494209a3c7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:02.821181 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-17005812-0f99-401e-8840-53494209a3c7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:02.838240 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-17005812-0f99-401e-8840-53494209a3c7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:02.839388 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-17005812-0f99-401e-8840-53494209a3c7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:02.840254 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-17005812-0f99-401e-8840-53494209a3c7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:02.840695 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-17005812-0f99-401e-8840-53494209a3c7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:02.860839 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f38b0ed8-5b80-43f7-8b82-5bd7e02ef0a8 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:02.871529 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f38b0ed8-5b80-43f7-8b82-5bd7e02ef0a8 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1357 microversion: 2.1 time: 0.426637 Apr 08 02:56:02.872503 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 433/844] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:02 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1357 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:56:03.192980 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-17005812-0f99-401e-8840-53494209a3c7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:03.202008 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-17005812-0f99-401e-8840-53494209a3c7 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1680 microversion: 2.1 time: 0.390188 Apr 08 02:56:03.208451 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 412/845] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:02 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1680 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:56:03.889352 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4629e4ac-a61d-45f1-8e26-345f4c9e19e4 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:03.890030 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4629e4ac-a61d-45f1-8e26-345f4c9e19e4 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:03.897435 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4629e4ac-a61d-45f1-8e26-345f4c9e19e4 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:03.897944 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4629e4ac-a61d-45f1-8e26-345f4c9e19e4 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:03.898781 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4629e4ac-a61d-45f1-8e26-345f4c9e19e4 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:03.899222 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4629e4ac-a61d-45f1-8e26-345f4c9e19e4 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:04.115375 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-4629e4ac-a61d-45f1-8e26-345f4c9e19e4 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:04.124295 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-4629e4ac-a61d-45f1-8e26-345f4c9e19e4 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1357 microversion: 2.1 time: 0.239153 Apr 08 02:56:04.124866 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 434/846] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:03 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:04.417553 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-35fbfb70-7565-4100-8974-0d17dfe8c990 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:04.418915 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-35fbfb70-7565-4100-8974-0d17dfe8c990 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:04.426832 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-35fbfb70-7565-4100-8974-0d17dfe8c990 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:04.427391 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-35fbfb70-7565-4100-8974-0d17dfe8c990 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:04.428258 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-35fbfb70-7565-4100-8974-0d17dfe8c990 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:04.428883 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-35fbfb70-7565-4100-8974-0d17dfe8c990 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:04.793517 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-35fbfb70-7565-4100-8974-0d17dfe8c990 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:04.801685 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-35fbfb70-7565-4100-8974-0d17dfe8c990 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1680 microversion: 2.1 time: 0.586404 Apr 08 02:56:04.802255 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 413/847] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:04 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1680 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:56:05.141339 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-7ff5ae0c-3db3-431b-a224-e4148298cf58 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:05.141882 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-7ff5ae0c-3db3-431b-a224-e4148298cf58 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:05.149150 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7ff5ae0c-3db3-431b-a224-e4148298cf58 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:05.149597 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7ff5ae0c-3db3-431b-a224-e4148298cf58 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:05.150412 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7ff5ae0c-3db3-431b-a224-e4148298cf58 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:05.151393 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-7ff5ae0c-3db3-431b-a224-e4148298cf58 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:05.347017 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-7ff5ae0c-3db3-431b-a224-e4148298cf58 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:05.356425 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-7ff5ae0c-3db3-431b-a224-e4148298cf58 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1357 microversion: 2.1 time: 0.219026 Apr 08 02:56:05.356984 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 435/848] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:05 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:05.819562 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-777f86e7-fe23-414e-af18-76c19975708c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:05.820211 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-777f86e7-fe23-414e-af18-76c19975708c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:05.827619 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-777f86e7-fe23-414e-af18-76c19975708c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:05.828109 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-777f86e7-fe23-414e-af18-76c19975708c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:05.828884 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-777f86e7-fe23-414e-af18-76c19975708c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:05.829320 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-777f86e7-fe23-414e-af18-76c19975708c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:06.019948 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-777f86e7-fe23-414e-af18-76c19975708c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a64fb1ebd9411eb6156c8ef97c3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee869d0592334c418ed6cf2b4ba04ace', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:06.029060 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-777f86e7-fe23-414e-af18-76c19975708c tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 200 len: 1613 microversion: 2.1 time: 0.212923 Apr 08 02:56:06.029892 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 414/849] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:05 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 1613 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:06.247210 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-f0d398f1-d776-4bed-831e-b3996f7a9ab2 req-4ecfe82b-b634-4fb4-ac40-cb2c2c706be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfe12a9-7278-44ab-b795-c7b012fdbe6e", "name": "network-vif-deleted", "tag": "105e599f-0cdc-4b32-9684-f0286bd3064f"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:06.249564 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:56:06.249564 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:56:06.257959 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-f0d398f1-d776-4bed-831e-b3996f7a9ab2 req-4ecfe82b-b634-4fb4-ac40-cb2c2c706be5 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:06.258400 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-f0d398f1-d776-4bed-831e-b3996f7a9ab2 req-4ecfe82b-b634-4fb4-ac40-cb2c2c706be5 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:06.275603 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-f0d398f1-d776-4bed-831e-b3996f7a9ab2 req-4ecfe82b-b634-4fb4-ac40-cb2c2c706be5 service nova] Creating event network-vif-deleted:105e599f-0cdc-4b32-9684-f0286bd3064f for instance 7cfe12a9-7278-44ab-b795-c7b012fdbe6e on hv-cinder-83705 Apr 08 02:56:06.281462 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-f0d398f1-d776-4bed-831e-b3996f7a9ab2 req-4ecfe82b-b634-4fb4-ac40-cb2c2c706be5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037926 Apr 08 02:56:06.282116 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 436/850] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:06.375405 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-01a89739-7af7-4159-b67b-b5f2ac2953f6 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:06.376368 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-01a89739-7af7-4159-b67b-b5f2ac2953f6 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:06.383542 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-01a89739-7af7-4159-b67b-b5f2ac2953f6 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:06.384016 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-01a89739-7af7-4159-b67b-b5f2ac2953f6 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:06.384927 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-01a89739-7af7-4159-b67b-b5f2ac2953f6 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:06.386192 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-01a89739-7af7-4159-b67b-b5f2ac2953f6 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:06.594354 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-01a89739-7af7-4159-b67b-b5f2ac2953f6 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:06.602566 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-01a89739-7af7-4159-b67b-b5f2ac2953f6 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1357 microversion: 2.1 time: 0.232505 Apr 08 02:56:06.603138 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 415/851] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:06 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1357 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:07.047410 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f26cc45e-9bc5-4c28-8a0c-9cba415b01e8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:07.048780 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f26cc45e-9bc5-4c28-8a0c-9cba415b01e8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:07.057996 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f26cc45e-9bc5-4c28-8a0c-9cba415b01e8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:07.058604 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f26cc45e-9bc5-4c28-8a0c-9cba415b01e8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:07.059133 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f26cc45e-9bc5-4c28-8a0c-9cba415b01e8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:07.060131 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f26cc45e-9bc5-4c28-8a0c-9cba415b01e8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:07.117761 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-f26cc45e-9bc5-4c28-8a0c-9cba415b01e8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] HTTP exception thrown: Instance 7cfe12a9-7278-44ab-b795-c7b012fdbe6e could not be found. Apr 08 02:56:07.120511 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f26cc45e-9bc5-4c28-8a0c-9cba415b01e8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Returning 404 to user: Instance 7cfe12a9-7278-44ab-b795-c7b012fdbe6e could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:56:07.121563 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f26cc45e-9bc5-4c28-8a0c-9cba415b01e8 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 404 len: 111 microversion: 2.1 time: 0.078299 Apr 08 02:56:07.122125 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 437/852] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:07 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:07.130895 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4656e424-314a-485a-9777-1df7981b19eb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '.version_select at 0x7fbc380f9e50>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:07.152968 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4656e424-314a-485a-9777-1df7981b19eb tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423644043" status: 202 len: 0 microversion: 2.1 time: 0.026096 Apr 08 02:56:07.158273 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 416/853] 10.222.0.23 () {58 vars in 1220 bytes} [Fri Apr 8 02:56:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423644043 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:56:07.618578 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-070609ae-9dce-4df8-b0d8-c2814da242bd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:07.619203 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-070609ae-9dce-4df8-b0d8-c2814da242bd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:07.626916 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-070609ae-9dce-4df8-b0d8-c2814da242bd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:07.627654 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-070609ae-9dce-4df8-b0d8-c2814da242bd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:07.628472 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-070609ae-9dce-4df8-b0d8-c2814da242bd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:07.628906 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-070609ae-9dce-4df8-b0d8-c2814da242bd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:08.096083 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-070609ae-9dce-4df8-b0d8-c2814da242bd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:08.104909 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-070609ae-9dce-4df8-b0d8-c2814da242bd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1357 microversion: 2.1 time: 0.489337 Apr 08 02:56:08.105483 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 438/854] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:07 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1357 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:09.126140 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-cd1abb75-83a2-4434-aaf3-777f671c6ef5 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:09.127241 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-116e9e1f-f04e-4369-a7ad-769780c4f8ae req-846dfcc4-1560-4a47-8807-20d0eb8d1079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb2b2fc-3410-4860-a03b-cab8c080197c", "name": "network-vif-plugged", "status": "completed", "tag": "c585c168-7e51-4ca1-8f45-2f19dde4b67a"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:09.128893 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:56:09.128893 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:56:09.132044 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-cd1abb75-83a2-4434-aaf3-777f671c6ef5 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:09.142983 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cd1abb75-83a2-4434-aaf3-777f671c6ef5 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:09.143437 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cd1abb75-83a2-4434-aaf3-777f671c6ef5 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:09.144230 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cd1abb75-83a2-4434-aaf3-777f671c6ef5 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:09.144827 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cd1abb75-83a2-4434-aaf3-777f671c6ef5 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:09.163151 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-116e9e1f-f04e-4369-a7ad-769780c4f8ae req-846dfcc4-1560-4a47-8807-20d0eb8d1079 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:09.164611 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-116e9e1f-f04e-4369-a7ad-769780c4f8ae req-846dfcc4-1560-4a47-8807-20d0eb8d1079 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:09.192899 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-116e9e1f-f04e-4369-a7ad-769780c4f8ae req-846dfcc4-1560-4a47-8807-20d0eb8d1079 service nova] Creating event network-vif-plugged:c585c168-7e51-4ca1-8f45-2f19dde4b67a for instance aeb2b2fc-3410-4860-a03b-cab8c080197c on hv-cinder-83705 Apr 08 02:56:09.200009 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-116e9e1f-f04e-4369-a7ad-769780c4f8ae req-846dfcc4-1560-4a47-8807-20d0eb8d1079 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143964 Apr 08 02:56:09.200805 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 417/855] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:09.402106 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cd1abb75-83a2-4434-aaf3-777f671c6ef5 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:09.410991 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-cd1abb75-83a2-4434-aaf3-777f671c6ef5 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1357 microversion: 2.1 time: 0.293043 Apr 08 02:56:09.411771 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 439/856] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:09 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1357 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:10.432817 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-441662ef-2ca6-4635-a18c-359268bdc4db tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:10.433852 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-441662ef-2ca6-4635-a18c-359268bdc4db tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:10.444938 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-441662ef-2ca6-4635-a18c-359268bdc4db tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:10.445445 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-441662ef-2ca6-4635-a18c-359268bdc4db tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:10.446303 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-441662ef-2ca6-4635-a18c-359268bdc4db tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:10.446781 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-441662ef-2ca6-4635-a18c-359268bdc4db tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:10.570303 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-de683887-acda-481a-a871-b8324075039f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:10.570874 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-de683887-acda-481a-a871-b8324075039f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:10.579364 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-de683887-acda-481a-a871-b8324075039f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:10.580096 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-de683887-acda-481a-a871-b8324075039f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:10.580945 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-de683887-acda-481a-a871-b8324075039f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:10.581383 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-de683887-acda-481a-a871-b8324075039f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:10.644757 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-de683887-acda-481a-a871-b8324075039f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] HTTP exception thrown: Instance 7cfe12a9-7278-44ab-b795-c7b012fdbe6e could not be found. Apr 08 02:56:10.645335 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-de683887-acda-481a-a871-b8324075039f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Returning 404 to user: Instance 7cfe12a9-7278-44ab-b795-c7b012fdbe6e could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:56:10.646165 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-de683887-acda-481a-a871-b8324075039f tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 404 len: 111 microversion: 2.1 time: 0.079998 Apr 08 02:56:10.649746 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 440/857] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:56:10 2022] DELETE /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:56:10.655079 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-95a50de1-25ce-4ecb-b416-3dcb7b5134e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:10.655688 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-95a50de1-25ce-4ecb-b416-3dcb7b5134e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: 7cfe12a9-7278-44ab-b795-c7b012fdbe6e] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:10.663470 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-95a50de1-25ce-4ecb-b416-3dcb7b5134e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:10.663916 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-95a50de1-25ce-4ecb-b416-3dcb7b5134e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:10.664702 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-95a50de1-25ce-4ecb-b416-3dcb7b5134e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:10.665132 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-95a50de1-25ce-4ecb-b416-3dcb7b5134e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:10.704526 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-441662ef-2ca6-4635-a18c-359268bdc4db tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:10.713118 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-441662ef-2ca6-4635-a18c-359268bdc4db tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1357 microversion: 2.1 time: 0.288003 Apr 08 02:56:10.726330 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-95a50de1-25ce-4ecb-b416-3dcb7b5134e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] HTTP exception thrown: Instance 7cfe12a9-7278-44ab-b795-c7b012fdbe6e could not be found. Apr 08 02:56:10.726330 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-95a50de1-25ce-4ecb-b416-3dcb7b5134e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Returning 404 to user: Instance 7cfe12a9-7278-44ab-b795-c7b012fdbe6e could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:56:10.726330 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-95a50de1-25ce-4ecb-b416-3dcb7b5134e6 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e" status: 404 len: 111 microversion: 2.1 time: 0.071316 Apr 08 02:56:10.726330 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 441/858] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:10 2022] GET /compute/v2.1/servers/7cfe12a9-7278-44ab-b795-c7b012fdbe6e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:10.726975 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 418/859] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:10 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1357 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:11.734303 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ff22e9a8-222d-4625-b03d-79858d1f6e9a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:11.734914 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ff22e9a8-222d-4625-b03d-79858d1f6e9a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:11.742077 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ff22e9a8-222d-4625-b03d-79858d1f6e9a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:11.742527 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ff22e9a8-222d-4625-b03d-79858d1f6e9a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:11.743282 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ff22e9a8-222d-4625-b03d-79858d1f6e9a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:11.743714 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ff22e9a8-222d-4625-b03d-79858d1f6e9a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:11.961159 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ff22e9a8-222d-4625-b03d-79858d1f6e9a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:11.966858 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-633059e3-31b8-4abb-9458-9a97bda31516 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:11.968237 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-633059e3-31b8-4abb-9458-9a97bda31516 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:11.972947 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ff22e9a8-222d-4625-b03d-79858d1f6e9a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1548 microversion: 2.1 time: 0.241997 Apr 08 02:56:11.974219 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 442/860] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:11 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1548 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:11.976210 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-633059e3-31b8-4abb-9458-9a97bda31516 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:11.976919 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-633059e3-31b8-4abb-9458-9a97bda31516 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:11.977986 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-633059e3-31b8-4abb-9458-9a97bda31516 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:11.978584 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-633059e3-31b8-4abb-9458-9a97bda31516 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:11.997215 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5bd5995e-0f1a-4a8c-b5c1-0badcab868bd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:11.997829 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5bd5995e-0f1a-4a8c-b5c1-0badcab868bd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:12.005702 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5bd5995e-0f1a-4a8c-b5c1-0badcab868bd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:12.006287 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5bd5995e-0f1a-4a8c-b5c1-0badcab868bd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:12.007339 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5bd5995e-0f1a-4a8c-b5c1-0badcab868bd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:12.007777 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5bd5995e-0f1a-4a8c-b5c1-0badcab868bd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:12.032771 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-633059e3-31b8-4abb-9458-9a97bda31516 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] HTTP exception thrown: Instance d509168a-9e7c-4ff6-b331-343f649a2944 could not be found. Apr 08 02:56:12.033668 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-633059e3-31b8-4abb-9458-9a97bda31516 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Returning 404 to user: Instance d509168a-9e7c-4ff6-b331-343f649a2944 could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:56:12.034908 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-633059e3-31b8-4abb-9458-9a97bda31516 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 404 len: 111 microversion: 2.1 time: 0.071777 Apr 08 02:56:12.035549 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 419/861] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:56:11 2022] DELETE /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:12.047744 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8b76f74d-3360-456a-a811-d5493c040cdd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:12.048657 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-8b76f74d-3360-456a-a811-d5493c040cdd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d509168a-9e7c-4ff6-b331-343f649a2944] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:12.059528 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8b76f74d-3360-456a-a811-d5493c040cdd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:12.060185 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8b76f74d-3360-456a-a811-d5493c040cdd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:12.061685 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8b76f74d-3360-456a-a811-d5493c040cdd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:12.062280 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8b76f74d-3360-456a-a811-d5493c040cdd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:12.118195 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-8b76f74d-3360-456a-a811-d5493c040cdd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] HTTP exception thrown: Instance d509168a-9e7c-4ff6-b331-343f649a2944 could not be found. Apr 08 02:56:12.118795 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8b76f74d-3360-456a-a811-d5493c040cdd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Returning 404 to user: Instance d509168a-9e7c-4ff6-b331-343f649a2944 could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:56:12.119624 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8b76f74d-3360-456a-a811-d5493c040cdd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944" status: 404 len: 111 microversion: 2.1 time: 0.079899 Apr 08 02:56:12.120881 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 420/862] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:12 2022] GET /compute/v2.1/servers/d509168a-9e7c-4ff6-b331-343f649a2944 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:56:12.138292 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-91fc90c6-cddc-4245-9562-98fae299c1fd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:12.138292 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-91fc90c6-cddc-4245-9562-98fae299c1fd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:12.141460 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-91fc90c6-cddc-4245-9562-98fae299c1fd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:12.141942 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-91fc90c6-cddc-4245-9562-98fae299c1fd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:12.142750 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-91fc90c6-cddc-4245-9562-98fae299c1fd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:12.143185 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-91fc90c6-cddc-4245-9562-98fae299c1fd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:12.194060 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-91fc90c6-cddc-4245-9562-98fae299c1fd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] HTTP exception thrown: Instance df7f7249-30e7-40a1-9854-881972b2ed1a could not be found. Apr 08 02:56:12.194655 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-91fc90c6-cddc-4245-9562-98fae299c1fd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Returning 404 to user: Instance df7f7249-30e7-40a1-9854-881972b2ed1a could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:56:12.195477 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-91fc90c6-cddc-4245-9562-98fae299c1fd tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 404 len: 111 microversion: 2.1 time: 0.070501 Apr 08 02:56:12.196058 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 421/863] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:56:12 2022] DELETE /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:12.203470 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a90886da-efc9-492d-93d0-94b17e9ef5df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:12.204106 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a90886da-efc9-492d-93d0-94b17e9ef5df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: df7f7249-30e7-40a1-9854-881972b2ed1a] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:12.211245 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a90886da-efc9-492d-93d0-94b17e9ef5df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:12.211692 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a90886da-efc9-492d-93d0-94b17e9ef5df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:12.212483 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a90886da-efc9-492d-93d0-94b17e9ef5df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:12.212917 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a90886da-efc9-492d-93d0-94b17e9ef5df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:12.265120 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-a90886da-efc9-492d-93d0-94b17e9ef5df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] HTTP exception thrown: Instance df7f7249-30e7-40a1-9854-881972b2ed1a could not be found. Apr 08 02:56:12.265727 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a90886da-efc9-492d-93d0-94b17e9ef5df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Returning 404 to user: Instance df7f7249-30e7-40a1-9854-881972b2ed1a could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:56:12.266574 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a90886da-efc9-492d-93d0-94b17e9ef5df tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a" status: 404 len: 111 microversion: 2.1 time: 0.066525 Apr 08 02:56:12.267120 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 422/864] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:12 2022] GET /compute/v2.1/servers/df7f7249-30e7-40a1-9854-881972b2ed1a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:56:12.550388 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5bd5995e-0f1a-4a8c-b5c1-0badcab868bd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:12.559773 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5bd5995e-0f1a-4a8c-b5c1-0badcab868bd tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1548 microversion: 2.1 time: 0.566958 Apr 08 02:56:12.560361 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 443/865] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:11 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1548 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:56:12.576069 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fceae886-3b19-4332-b561-14b49248814c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:12.579433 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:56:12.579433 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:56:12.580632 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fceae886-3b19-4332-b561-14b49248814c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:12.581464 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-fceae886-3b19-4332-b561-14b49248814c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Searching by: {'deleted': False, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb'} {{(pid=101271) get_all /opt/stack/nova/nova/compute/api.py:2855}} Apr 08 02:56:12.586921 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fceae886-3b19-4332-b561-14b49248814c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:12.587448 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fceae886-3b19-4332-b561-14b49248814c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:12.588357 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fceae886-3b19-4332-b561-14b49248814c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:12.588892 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fceae886-3b19-4332-b561-14b49248814c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:12.680102 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.multi_cell_list [None req-fceae886-3b19-4332-b561-14b49248814c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=101271) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Apr 08 02:56:12.772391 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-fceae886-3b19-4332-b561-14b49248814c tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200639 Apr 08 02:56:12.773201 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 423/866] 10.222.0.23 () {58 vars in 1124 bytes} [Fri Apr 8 02:56:12 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:12.784146 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e2d12f45-6d95-4417-b9f3-5131f8ef417f tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:12.784765 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e2d12f45-6d95-4417-b9f3-5131f8ef417f tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:12.792668 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e2d12f45-6d95-4417-b9f3-5131f8ef417f tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:12.793337 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e2d12f45-6d95-4417-b9f3-5131f8ef417f tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:12.794109 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e2d12f45-6d95-4417-b9f3-5131f8ef417f tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:12.794550 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e2d12f45-6d95-4417-b9f3-5131f8ef417f tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:13.256841 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e2d12f45-6d95-4417-b9f3-5131f8ef417f tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:13.265596 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e2d12f45-6d95-4417-b9f3-5131f8ef417f tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1548 microversion: 2.1 time: 0.485117 Apr 08 02:56:13.266260 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 444/867] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:12 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1548 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:13.586014 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-47054a8e-f238-4366-a155-13f91593df68 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:13.586516 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-47054a8e-f238-4366-a155-13f91593df68 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:13.606361 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-47054a8e-f238-4366-a155-13f91593df68 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:13.606817 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-47054a8e-f238-4366-a155-13f91593df68 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:13.608167 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-47054a8e-f238-4366-a155-13f91593df68 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:13.608615 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-47054a8e-f238-4366-a155-13f91593df68 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:13.693629 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-47054a8e-f238-4366-a155-13f91593df68 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] HTTP exception thrown: Instance d7ae39c8-31a8-4fff-854c-06275d09d237 could not be found. Apr 08 02:56:13.694482 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-47054a8e-f238-4366-a155-13f91593df68 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Returning 404 to user: Instance d7ae39c8-31a8-4fff-854c-06275d09d237 could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:56:13.695487 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-47054a8e-f238-4366-a155-13f91593df68 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 404 len: 111 microversion: 2.1 time: 0.113691 Apr 08 02:56:13.697324 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 424/868] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:56:13 2022] DELETE /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:13.707194 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d922bba0-283a-4b12-aa0c-d4770f36ec44 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:13.708320 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d922bba0-283a-4b12-aa0c-d4770f36ec44 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] [instance: d7ae39c8-31a8-4fff-854c-06275d09d237] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:13.719611 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d922bba0-283a-4b12-aa0c-d4770f36ec44 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:13.720431 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d922bba0-283a-4b12-aa0c-d4770f36ec44 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:13.723361 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d922bba0-283a-4b12-aa0c-d4770f36ec44 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:13.724029 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d922bba0-283a-4b12-aa0c-d4770f36ec44 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:13.798888 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-d922bba0-283a-4b12-aa0c-d4770f36ec44 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] HTTP exception thrown: Instance d7ae39c8-31a8-4fff-854c-06275d09d237 could not be found. Apr 08 02:56:13.799495 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d922bba0-283a-4b12-aa0c-d4770f36ec44 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] Returning 404 to user: Instance d7ae39c8-31a8-4fff-854c-06275d09d237 could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:56:13.800970 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d922bba0-283a-4b12-aa0c-d4770f36ec44 tempest-AttachVolumeNegativeTest-486794643 tempest-AttachVolumeNegativeTest-486794643-project] 10.222.0.23 "GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237" status: 404 len: 111 microversion: 2.1 time: 0.098817 Apr 08 02:56:13.801564 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 445/869] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:13 2022] GET /compute/v2.1/servers/d7ae39c8-31a8-4fff-854c-06275d09d237 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:56:13.890488 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f17aba00-cb42-4e8d-bff1-736b66a9f39e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:13.890984 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f17aba00-cb42-4e8d-bff1-736b66a9f39e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:13.908943 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f17aba00-cb42-4e8d-bff1-736b66a9f39e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:13.909401 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f17aba00-cb42-4e8d-bff1-736b66a9f39e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:13.910185 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f17aba00-cb42-4e8d-bff1-736b66a9f39e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:13.916319 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f17aba00-cb42-4e8d-bff1-736b66a9f39e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:13.987416 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-339c28fa-8127-4a2d-9385-abc8445db738 req-22ebcf0d-36ef-436d-afd2-56a069cc5e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c826480b-a813-4281-83a6-c743d8a84b9c", "tag": "105b6cec-7cb5-414f-809c-11a2bc5ec384"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:13.989133 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:56:13.989133 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:56:13.995964 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f17aba00-cb42-4e8d-bff1-736b66a9f39e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Going to try to terminate instance {{(pid=101271) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:56:13.998406 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-339c28fa-8127-4a2d-9385-abc8445db738 req-22ebcf0d-36ef-436d-afd2-56a069cc5e76 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:13.998845 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-339c28fa-8127-4a2d-9385-abc8445db738 req-22ebcf0d-36ef-436d-afd2-56a069cc5e76 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:14.016845 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-339c28fa-8127-4a2d-9385-abc8445db738 req-22ebcf0d-36ef-436d-afd2-56a069cc5e76 service nova] Creating event network-changed:105b6cec-7cb5-414f-809c-11a2bc5ec384 for instance c826480b-a813-4281-83a6-c743d8a84b9c on hv-cinder-83705 Apr 08 02:56:14.022006 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-339c28fa-8127-4a2d-9385-abc8445db738 req-22ebcf0d-36ef-436d-afd2-56a069cc5e76 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127800 Apr 08 02:56:14.023092 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 446/870] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:14.140444 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f17aba00-cb42-4e8d-bff1-736b66a9f39e tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 204 len: 0 microversion: 2.1 time: 0.253174 Apr 08 02:56:14.141442 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 425/871] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:56:13 2022] DELETE /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:56:14.153129 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-6fbd07ad-ed48-4689-93a8-3d415c37967f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:14.154044 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-6fbd07ad-ed48-4689-93a8-3d415c37967f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:14.162179 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6fbd07ad-ed48-4689-93a8-3d415c37967f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:14.162624 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6fbd07ad-ed48-4689-93a8-3d415c37967f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:14.163394 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6fbd07ad-ed48-4689-93a8-3d415c37967f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:14.163962 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6fbd07ad-ed48-4689-93a8-3d415c37967f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:14.571737 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-6fbd07ad-ed48-4689-93a8-3d415c37967f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:14.587919 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-6fbd07ad-ed48-4689-93a8-3d415c37967f tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1568 microversion: 2.1 time: 0.441261 Apr 08 02:56:14.590695 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 447/872] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:14 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1568 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:15.606868 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-db87c0d9-58ae-44c5-b714-4621f9d32e09 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:15.607570 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-db87c0d9-58ae-44c5-b714-4621f9d32e09 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:15.614782 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-db87c0d9-58ae-44c5-b714-4621f9d32e09 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:15.615229 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-db87c0d9-58ae-44c5-b714-4621f9d32e09 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:15.616025 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-db87c0d9-58ae-44c5-b714-4621f9d32e09 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:15.616459 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-db87c0d9-58ae-44c5-b714-4621f9d32e09 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:15.817883 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-db87c0d9-58ae-44c5-b714-4621f9d32e09 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:15.827444 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-db87c0d9-58ae-44c5-b714-4621f9d32e09 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1449 microversion: 2.1 time: 0.225434 Apr 08 02:56:15.828046 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 426/873] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:15 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1449 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:16.210199 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4e1f6a52-8a70-4f9d-a734-c9c4e1523527 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e234d45-4289-4337-a746-eb1e551fb172"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:16.211858 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4e1f6a52-8a70-4f9d-a734-c9c4e1523527 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:16.219520 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4e1f6a52-8a70-4f9d-a734-c9c4e1523527 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:16.220381 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4e1f6a52-8a70-4f9d-a734-c9c4e1523527 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:16.221306 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4e1f6a52-8a70-4f9d-a734-c9c4e1523527 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:16.221645 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4e1f6a52-8a70-4f9d-a734-c9c4e1523527 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:16.683896 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-4e1f6a52-8a70-4f9d-a734-c9c4e1523527 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "POST /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.477244 Apr 08 02:56:16.689306 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 448/874] 10.222.0.23 () {60 vars in 1322 bytes} [Fri Apr 8 02:56:16 2022] POST /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c/os-volume_attachments => generated 194 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:16.845981 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-77081fe6-18b4-4bb2-b072-f78fa6a0a7bd tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:16.847405 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-77081fe6-18b4-4bb2-b072-f78fa6a0a7bd tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:16.856116 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-77081fe6-18b4-4bb2-b072-f78fa6a0a7bd tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:16.856861 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-77081fe6-18b4-4bb2-b072-f78fa6a0a7bd tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:16.857837 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-77081fe6-18b4-4bb2-b072-f78fa6a0a7bd tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:16.859135 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-77081fe6-18b4-4bb2-b072-f78fa6a0a7bd tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:17.232942 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-77081fe6-18b4-4bb2-b072-f78fa6a0a7bd tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:17.260023 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-77081fe6-18b4-4bb2-b072-f78fa6a0a7bd tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1449 microversion: 2.1 time: 0.418619 Apr 08 02:56:17.261612 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 427/875] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:16 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1449 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:17.334413 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-a1f7cc74-e98c-40d9-8905-b35d0f4ab8e6 req-7a19169f-3bad-4e50-abb3-b7474d6afcd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c826480b-a813-4281-83a6-c743d8a84b9c", "name": "network-vif-deleted", "tag": "105b6cec-7cb5-414f-809c-11a2bc5ec384"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:17.337200 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:56:17.337200 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:56:17.348173 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-a1f7cc74-e98c-40d9-8905-b35d0f4ab8e6 req-7a19169f-3bad-4e50-abb3-b7474d6afcd3 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:17.349189 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-a1f7cc74-e98c-40d9-8905-b35d0f4ab8e6 req-7a19169f-3bad-4e50-abb3-b7474d6afcd3 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:17.368409 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-a1f7cc74-e98c-40d9-8905-b35d0f4ab8e6 req-7a19169f-3bad-4e50-abb3-b7474d6afcd3 service nova] Creating event network-vif-deleted:105b6cec-7cb5-414f-809c-11a2bc5ec384 for instance c826480b-a813-4281-83a6-c743d8a84b9c on hv-cinder-83705 Apr 08 02:56:17.374141 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-a1f7cc74-e98c-40d9-8905-b35d0f4ab8e6 req-7a19169f-3bad-4e50-abb3-b7474d6afcd3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045967 Apr 08 02:56:17.375349 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 449/876] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:56:18.278054 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2c08d0c9-4cf0-4e9d-b7ff-114f7bc096d9 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:18.278833 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2c08d0c9-4cf0-4e9d-b7ff-114f7bc096d9 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:18.286214 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2c08d0c9-4cf0-4e9d-b7ff-114f7bc096d9 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:18.286782 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2c08d0c9-4cf0-4e9d-b7ff-114f7bc096d9 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:18.289362 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2c08d0c9-4cf0-4e9d-b7ff-114f7bc096d9 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:18.289362 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2c08d0c9-4cf0-4e9d-b7ff-114f7bc096d9 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:18.359981 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2c08d0c9-4cf0-4e9d-b7ff-114f7bc096d9 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:18.360649 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2c08d0c9-4cf0-4e9d-b7ff-114f7bc096d9 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:18.361273 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.objects.instance [None req-2c08d0c9-4cf0-4e9d-b7ff-114f7bc096d9 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lazy-loading 'fault' on Instance uuid c826480b-a813-4281-83a6-c743d8a84b9c {{(pid=101271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:56:18.455519 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2c08d0c9-4cf0-4e9d-b7ff-114f7bc096d9 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f675843ecb4ef2b4c1b450b6bacf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7f360a7ebf4464b91dce9442330898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:18.465066 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2c08d0c9-4cf0-4e9d-b7ff-114f7bc096d9 tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 200 len: 1223 microversion: 2.1 time: 0.191282 Apr 08 02:56:18.465909 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 428/877] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:18 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 1223 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:19.483327 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4d31eedf-fc35-412e-9c87-a7d6cbe9f2cf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:19.484085 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4d31eedf-fc35-412e-9c87-a7d6cbe9f2cf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] [instance: c826480b-a813-4281-83a6-c743d8a84b9c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:19.492002 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4d31eedf-fc35-412e-9c87-a7d6cbe9f2cf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:19.492802 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4d31eedf-fc35-412e-9c87-a7d6cbe9f2cf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:19.493803 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4d31eedf-fc35-412e-9c87-a7d6cbe9f2cf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:19.494458 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4d31eedf-fc35-412e-9c87-a7d6cbe9f2cf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:19.552493 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-4d31eedf-fc35-412e-9c87-a7d6cbe9f2cf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] HTTP exception thrown: Instance c826480b-a813-4281-83a6-c743d8a84b9c could not be found. Apr 08 02:56:19.553104 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4d31eedf-fc35-412e-9c87-a7d6cbe9f2cf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Returning 404 to user: Instance c826480b-a813-4281-83a6-c743d8a84b9c could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:56:19.553954 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-4d31eedf-fc35-412e-9c87-a7d6cbe9f2cf tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c" status: 404 len: 111 microversion: 2.1 time: 0.075067 Apr 08 02:56:19.554864 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 450/878] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:19 2022] GET /compute/v2.1/servers/c826480b-a813-4281-83a6-c743d8a84b9c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:19.782951 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-91a7e9a4-9805-42d0-a232-b48115dba1dd tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] Calling method '.version_select at 0x7fbc3827d040>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:19.802036 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-91a7e9a4-9805-42d0-a232-b48115dba1dd tempest-TestShelveInstance-1650952422 tempest-TestShelveInstance-1650952422-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-444463297" status: 202 len: 0 microversion: 2.1 time: 0.022718 Apr 08 02:56:19.802608 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 429/879] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Apr 8 02:56:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-444463297 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:56:21.252482 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-910a86fb-1ab8-4964-8b2e-899c800699f5 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Action: 'create', calling method: .version_select at 0x7fbc3907c9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-524950696"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:21.796839 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-910a86fb-1ab8-4964-8b2e-899c800699f5 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.694148 Apr 08 02:56:21.797389 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 451/880] 10.222.0.23 () {60 vars in 1154 bytes} [Fri Apr 8 02:56:21 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 695 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Apr 08 02:56:21.809083 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5d9aeaa4-086f-4d16-b824-f66ab2652843 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc38456b80>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:21.896838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-5d9aeaa4-086f-4d16-b824-f66ab2652843 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c" status: 200 len: 344 microversion: 2.1 time: 0.092216 Apr 08 02:56:21.897408 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 430/881] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Apr 8 02:56:21 2022] GET /compute/v2.1/os-volumes/f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c => generated 344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:56:22.910372 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0efeae9a-257f-4201-a4a0-b3434107c765 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc38380f70>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:23.008914 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0efeae9a-257f-4201-a4a0-b3434107c765 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c" status: 200 len: 345 microversion: 2.1 time: 0.102535 Apr 08 02:56:23.009926 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 452/882] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Apr 8 02:56:22 2022] GET /compute/v2.1/os-volumes/f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c => generated 345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:23.022449 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-206e45ad-eefa-4de1-ad4e-faa045619494 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Action: 'create', calling method: .version_select at 0x7fbc3863d4c0>, body: {"snapshot": {"volume_id": "f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-558209713"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:23.323756 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-206e45ad-eefa-4de1-ad4e-faa045619494 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.304708 Apr 08 02:56:23.333825 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c8e478b5-31a5-4191-a080-f518094bf599 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc3971e430>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:23.334052 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 431/883] 10.222.0.23 () {60 vars in 1161 bytes} [Fri Apr 8 02:56:23 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:23.405684 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c8e478b5-31a5-4191-a080-f518094bf599 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566" status: 200 len: 286 microversion: 2.1 time: 0.075351 Apr 08 02:56:23.406559 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 453/884] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Apr 8 02:56:23 2022] GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:23.419335 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-feb4d315-b237-49e8-8fdb-f11940907762 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc38606e50>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:23.469741 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-feb4d315-b237-49e8-8fdb-f11940907762 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.056583 Apr 08 02:56:23.472093 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 432/885] 10.222.0.23 () {58 vars in 1139 bytes} [Fri Apr 8 02:56:23 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:23.482031 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-69cf2289-b207-4219-947a-44d67971157a tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc382f0b80>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:23.530402 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-69cf2289-b207-4219-947a-44d67971157a tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566" status: 200 len: 286 microversion: 2.1 time: 0.053592 Apr 08 02:56:23.530974 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 454/886] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Apr 8 02:56:23 2022] GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566 => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:24.541939 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-069e6298-9711-4237-92c0-509c171bbd99 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc3848caf0>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:24.598988 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-069e6298-9711-4237-92c0-509c171bbd99 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566" status: 200 len: 286 microversion: 2.1 time: 0.060982 Apr 08 02:56:24.599554 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 433/887] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Apr 8 02:56:24 2022] GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:25.615734 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-68de15da-dd90-4fd0-9ad8-66fe25c19815 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc384c5670>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:25.681580 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-68de15da-dd90-4fd0-9ad8-66fe25c19815 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566" status: 200 len: 286 microversion: 2.1 time: 0.070979 Apr 08 02:56:25.687097 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 455/888] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Apr 8 02:56:25 2022] GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:26.693866 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a57e8d99-9c97-416d-b733-a47531bc6e6e tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc3827db80>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:26.740133 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a57e8d99-9c97-416d-b733-a47531bc6e6e tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566" status: 200 len: 286 microversion: 2.1 time: 0.049810 Apr 08 02:56:26.740716 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 434/889] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Apr 8 02:56:26 2022] GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:27.751610 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-93c4e178-03f7-4353-becd-8e1325693165 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc3849f8b0>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:27.797997 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-93c4e178-03f7-4353-becd-8e1325693165 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566" status: 200 len: 286 microversion: 2.1 time: 0.050070 Apr 08 02:56:27.798881 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 456/890] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Apr 8 02:56:27 2022] GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:28.149894 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c0feebea-e90b-4d00-a844-0d40281acbf8 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:28.150516 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c0feebea-e90b-4d00-a844-0d40281acbf8 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:28.158044 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c0feebea-e90b-4d00-a844-0d40281acbf8 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:28.158496 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c0feebea-e90b-4d00-a844-0d40281acbf8 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:28.159264 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c0feebea-e90b-4d00-a844-0d40281acbf8 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:28.159698 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c0feebea-e90b-4d00-a844-0d40281acbf8 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:28.535995 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c0feebea-e90b-4d00-a844-0d40281acbf8 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:28.546537 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c0feebea-e90b-4d00-a844-0d40281acbf8 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1594 microversion: 2.1 time: 0.400474 Apr 08 02:56:28.556432 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 435/891] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:28 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1594 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:28.663662 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9240e713-7680-4cbc-89f0-9d3c2a1266ea tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1743293606", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452", "networks": [{"uuid": "3024fc83-767b-4251-9cc8-eb502c5ce4a5"}]}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:28.738373 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.network.neutron [None req-9240e713-7680-4cbc-89f0-9d3c2a1266ea tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] validate_networks() for [('3024fc83-767b-4251-9cc8-eb502c5ce4a5', None, None, None)] {{(pid=101272) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:56:28.811635 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1f2a67e4-b637-447c-95b7-64deeb9e9457 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc38456b80>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:28.859430 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1f2a67e4-b637-447c-95b7-64deeb9e9457 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566" status: 200 len: 287 microversion: 2.1 time: 0.052751 Apr 08 02:56:28.860273 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 436/892] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Apr 8 02:56:28 2022] GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:56:28.871191 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-685ff41e-9351-4111-92e2-a50e6d64180d tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc3827d310>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:28.982596 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-685ff41e-9351-4111-92e2-a50e6d64180d tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566" status: 202 len: 0 microversion: 2.1 time: 0.116066 Apr 08 02:56:28.983256 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 437/893] 10.222.0.23 () {58 vars in 1253 bytes} [Fri Apr 8 02:56:28 2022] DELETE /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 02:56:28.990887 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4a980a3e-7c7e-405a-ac9f-05d8400f51ab tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc3827de50>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:29.039007 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4a980a3e-7c7e-405a-ac9f-05d8400f51ab tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566" status: 200 len: 286 microversion: 2.1 time: 0.051380 Apr 08 02:56:29.043475 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 438/894] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Apr 8 02:56:28 2022] GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:56:29.351305 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-9240e713-7680-4cbc-89f0-9d3c2a1266ea tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Flavor limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:56:29.351797 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-9240e713-7680-4cbc-89f0-9d3c2a1266ea tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Image limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:56:29.352280 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-9240e713-7680-4cbc-89f0-9d3c2a1266ea tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Flavor pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:56:29.352695 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-9240e713-7680-4cbc-89f0-9d3c2a1266ea tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Image pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:56:29.353115 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-9240e713-7680-4cbc-89f0-9d3c2a1266ea tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:56:29.362419 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9240e713-7680-4cbc-89f0-9d3c2a1266ea tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:29.362868 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9240e713-7680-4cbc-89f0-9d3c2a1266ea tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:29.363803 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9240e713-7680-4cbc-89f0-9d3c2a1266ea tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:29.364366 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9240e713-7680-4cbc-89f0-9d3c2a1266ea tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:29.382119 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-9240e713-7680-4cbc-89f0-9d3c2a1266ea tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Getting quotas for project 9e2629ed0483482588959ec1e5f818af. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:56:29.387222 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-9240e713-7680-4cbc-89f0-9d3c2a1266ea tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Getting quotas for user 4c73a12c1b6749b3882b510aef5cabe3 and project 9e2629ed0483482588959ec1e5f818af. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:56:29.397953 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9240e713-7680-4cbc-89f0-9d3c2a1266ea tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Going to run 1 instances... {{(pid=101272) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:56:29.400396 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9240e713-7680-4cbc-89f0-9d3c2a1266ea tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:56:29.448303 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9240e713-7680-4cbc-89f0-9d3c2a1266ea tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788234 Apr 08 02:56:29.449243 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 457/895] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:56:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:56:29.458736 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d75d0cc6-86c6-4653-a006-d09d97b474ad tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:29.459337 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-d75d0cc6-86c6-4653-a006-d09d97b474ad tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:29.611322 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-d75d0cc6-86c6-4653-a006-d09d97b474ad tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:29.620773 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-d75d0cc6-86c6-4653-a006-d09d97b474ad tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 200 len: 1214 microversion: 2.1 time: 0.165611 Apr 08 02:56:29.621358 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 439/896] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:29 2022] GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 1214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:30.051576 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d4cc8f6e-1c24-4485-bed2-1427262de0d6 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc382f0160>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:30.105905 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-d4cc8f6e-1c24-4485-bed2-1427262de0d6 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] HTTP exception thrown: Snapshot 0aaca0c4-7ca5-4c9e-952d-51f093ff9566 could not be found. Apr 08 02:56:30.106855 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d4cc8f6e-1c24-4485-bed2-1427262de0d6 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Returning 404 to user: Snapshot 0aaca0c4-7ca5-4c9e-952d-51f093ff9566 could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:56:30.108020 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d4cc8f6e-1c24-4485-bed2-1427262de0d6 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566" status: 404 len: 111 microversion: 2.1 time: 0.060319 Apr 08 02:56:30.108738 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 458/897] 10.222.0.23 () {58 vars in 1250 bytes} [Fri Apr 8 02:56:30 2022] GET /compute/v2.1/os-snapshots/0aaca0c4-7ca5-4c9e-952d-51f093ff9566 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:30.117391 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d7d43717-425c-450d-a159-32631351f0af tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc38606e50>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:30.295280 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-d7d43717-425c-450d-a159-32631351f0af tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c" status: 202 len: 0 microversion: 2.1 time: 0.181826 Apr 08 02:56:30.296561 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 440/898] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Apr 8 02:56:30 2022] DELETE /compute/v2.1/os-volumes/f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:56:30.305639 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-50ce8044-c3e3-41b8-90f9-bf5c54106af2 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc383801f0>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:30.394122 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-50ce8044-c3e3-41b8-90f9-bf5c54106af2 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c" status: 200 len: 344 microversion: 2.1 time: 0.093545 Apr 08 02:56:30.394704 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 459/899] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Apr 8 02:56:30 2022] GET /compute/v2.1/os-volumes/f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c => generated 344 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:30.640544 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fd7027f2-e8f7-4b23-822d-fb5616f861c8 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:30.641231 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-fd7027f2-e8f7-4b23-822d-fb5616f861c8 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:30.658048 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fd7027f2-e8f7-4b23-822d-fb5616f861c8 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:30.664369 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fd7027f2-e8f7-4b23-822d-fb5616f861c8 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:30.668912 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fd7027f2-e8f7-4b23-822d-fb5616f861c8 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:30.669407 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fd7027f2-e8f7-4b23-822d-fb5616f861c8 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:30.839501 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fd7027f2-e8f7-4b23-822d-fb5616f861c8 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:30.853388 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-fd7027f2-e8f7-4b23-822d-fb5616f861c8 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 200 len: 1274 microversion: 2.1 time: 0.216870 Apr 08 02:56:30.856125 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 441/900] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:30 2022] GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 1274 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:31.407291 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e894a3af-f428-4c4b-933a-83be231504e6 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc382f0d30>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:31.468726 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-e894a3af-f428-4c4b-933a-83be231504e6 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] HTTP exception thrown: Volume f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c could not be found. Apr 08 02:56:31.469571 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e894a3af-f428-4c4b-933a-83be231504e6 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Returning 404 to user: Volume f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:56:31.470383 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e894a3af-f428-4c4b-933a-83be231504e6 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c" status: 404 len: 109 microversion: 2.1 time: 0.067040 Apr 08 02:56:31.471230 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 460/901] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Apr 8 02:56:31 2022] GET /compute/v2.1/os-volumes/f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:31.485332 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c790157b-9bc0-4b86-9a8a-e0f2ca238807 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc3827d040>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:31.550597 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-c790157b-9bc0-4b86-9a8a-e0f2ca238807 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] HTTP exception thrown: Volume f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c could not be found. Apr 08 02:56:31.551202 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c790157b-9bc0-4b86-9a8a-e0f2ca238807 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Returning 404 to user: Volume f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:56:31.552092 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c790157b-9bc0-4b86-9a8a-e0f2ca238807 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c" status: 404 len: 109 microversion: 2.1 time: 0.070466 Apr 08 02:56:31.552638 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 442/902] 10.222.0.23 () {58 vars in 1247 bytes} [Fri Apr 8 02:56:31 2022] DELETE /compute/v2.1/os-volumes/f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:56:31.561811 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c82b0335-c4a0-42f0-a67c-c9922fd64c12 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Calling method '.version_select at 0x7fbc380f9280>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:31.631328 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-c82b0335-c4a0-42f0-a67c-c9922fd64c12 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] HTTP exception thrown: Volume f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c could not be found. Apr 08 02:56:31.633021 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c82b0335-c4a0-42f0-a67c-c9922fd64c12 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] Returning 404 to user: Volume f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:56:31.634485 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c82b0335-c4a0-42f0-a67c-c9922fd64c12 tempest-VolumesSnapshotsTestJSON-702464165 tempest-VolumesSnapshotsTestJSON-702464165-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c" status: 404 len: 109 microversion: 2.1 time: 0.077312 Apr 08 02:56:31.640036 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 461/903] 10.222.0.23 () {58 vars in 1244 bytes} [Fri Apr 8 02:56:31 2022] GET /compute/v2.1/os-volumes/f9ac3a41-53d9-47f2-8c15-a9e42d3adf8c => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:31.873371 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-08972351-3371-47ea-9d81-4d511092df0c tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:31.874285 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-08972351-3371-47ea-9d81-4d511092df0c tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:31.884121 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-08972351-3371-47ea-9d81-4d511092df0c tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:31.884559 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-08972351-3371-47ea-9d81-4d511092df0c tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:31.886329 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-08972351-3371-47ea-9d81-4d511092df0c tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:31.886782 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-08972351-3371-47ea-9d81-4d511092df0c tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:32.209407 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-08972351-3371-47ea-9d81-4d511092df0c tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:32.223091 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-08972351-3371-47ea-9d81-4d511092df0c tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 200 len: 1272 microversion: 2.1 time: 0.354062 Apr 08 02:56:32.224139 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 443/904] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:31 2022] GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 1272 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:33.241041 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5560fad1-ff22-4a0b-b0ea-6a597f885885 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:33.242729 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5560fad1-ff22-4a0b-b0ea-6a597f885885 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:33.251279 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5560fad1-ff22-4a0b-b0ea-6a597f885885 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:33.252078 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5560fad1-ff22-4a0b-b0ea-6a597f885885 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:33.253335 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5560fad1-ff22-4a0b-b0ea-6a597f885885 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:33.254115 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5560fad1-ff22-4a0b-b0ea-6a597f885885 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:33.562344 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5560fad1-ff22-4a0b-b0ea-6a597f885885 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:33.574287 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5560fad1-ff22-4a0b-b0ea-6a597f885885 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 200 len: 1314 microversion: 2.1 time: 0.336672 Apr 08 02:56:33.575613 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 462/905] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:33 2022] GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:33.596009 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-cc41fc25-1431-4dc0-b4b1-8d9c4cb6f9f9 req-9f569fb0-96bd-401d-b4c0-dd9c98130186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeb2b2fc-3410-4860-a03b-cab8c080197c", "tag": "c585c168-7e51-4ca1-8f45-2f19dde4b67a"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:33.598920 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:56:33.598920 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:56:33.622504 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-cc41fc25-1431-4dc0-b4b1-8d9c4cb6f9f9 req-9f569fb0-96bd-401d-b4c0-dd9c98130186 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:33.623473 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-cc41fc25-1431-4dc0-b4b1-8d9c4cb6f9f9 req-9f569fb0-96bd-401d-b4c0-dd9c98130186 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:33.654212 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-cc41fc25-1431-4dc0-b4b1-8d9c4cb6f9f9 req-9f569fb0-96bd-401d-b4c0-dd9c98130186 service nova] Creating event network-changed:c585c168-7e51-4ca1-8f45-2f19dde4b67a for instance aeb2b2fc-3410-4860-a03b-cab8c080197c on hv-cinder-83705 Apr 08 02:56:33.660116 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-cc41fc25-1431-4dc0-b4b1-8d9c4cb6f9f9 req-9f569fb0-96bd-401d-b4c0-dd9c98130186 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069875 Apr 08 02:56:33.661516 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 444/906] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:34.592606 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-b06c6e34-9578-417a-b182-af13f6403b94 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:34.595919 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-b06c6e34-9578-417a-b182-af13f6403b94 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:34.615142 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b06c6e34-9578-417a-b182-af13f6403b94 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:34.627522 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b06c6e34-9578-417a-b182-af13f6403b94 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:34.628532 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b06c6e34-9578-417a-b182-af13f6403b94 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:34.629043 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-b06c6e34-9578-417a-b182-af13f6403b94 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:35.146324 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-b06c6e34-9578-417a-b182-af13f6403b94 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:35.166948 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-b06c6e34-9578-417a-b182-af13f6403b94 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 200 len: 1314 microversion: 2.1 time: 0.579010 Apr 08 02:56:35.168249 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 463/907] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:34 2022] GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:35.681665 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-a5e7b010-09ba-4d26-a31b-3c7ed3cb3b69 req-d4c6d56e-9a3d-493e-947e-93536a69310b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d749573-0c49-4eda-98d4-9574a85913d2", "tag": "0581239e-a8d6-45ea-8e72-865ca68115b2"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:35.684239 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:56:35.684239 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:56:35.698756 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-a5e7b010-09ba-4d26-a31b-3c7ed3cb3b69 req-d4c6d56e-9a3d-493e-947e-93536a69310b service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:35.699548 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-a5e7b010-09ba-4d26-a31b-3c7ed3cb3b69 req-d4c6d56e-9a3d-493e-947e-93536a69310b service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:35.730181 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-a5e7b010-09ba-4d26-a31b-3c7ed3cb3b69 req-d4c6d56e-9a3d-493e-947e-93536a69310b service nova] Creating event network-changed:0581239e-a8d6-45ea-8e72-865ca68115b2 for instance 4d749573-0c49-4eda-98d4-9574a85913d2 on hv-cinder-83705 Apr 08 02:56:35.735436 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-a5e7b010-09ba-4d26-a31b-3c7ed3cb3b69 req-d4c6d56e-9a3d-493e-947e-93536a69310b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059601 Apr 08 02:56:35.736391 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 445/908] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:36.130405 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-33779229-979c-4f74-b17e-6c45d0ae9131 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1720633139"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:36.130979 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-33779229-979c-4f74-b17e-6c45d0ae9131 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:36.140387 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-33779229-979c-4f74-b17e-6c45d0ae9131 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:36.141169 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-33779229-979c-4f74-b17e-6c45d0ae9131 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:36.142754 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-33779229-979c-4f74-b17e-6c45d0ae9131 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:36.144239 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-33779229-979c-4f74-b17e-6c45d0ae9131 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:36.185104 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-afd8c4bb-5260-42a7-ae99-d6d38fa31fb6 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:36.186086 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-afd8c4bb-5260-42a7-ae99-d6d38fa31fb6 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:36.193745 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-afd8c4bb-5260-42a7-ae99-d6d38fa31fb6 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:36.194383 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-afd8c4bb-5260-42a7-ae99-d6d38fa31fb6 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:36.195302 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-afd8c4bb-5260-42a7-ae99-d6d38fa31fb6 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:36.195890 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-afd8c4bb-5260-42a7-ae99-d6d38fa31fb6 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:36.369084 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.network.security_group_api [None req-33779229-979c-4f74-b17e-6c45d0ae9131 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Adding security group c57ef43a-295b-43de-9373-934279b2ae58 to port c585c168-7e51-4ca1-8f45-2f19dde4b67a Apr 08 02:56:36.716168 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-afd8c4bb-5260-42a7-ae99-d6d38fa31fb6 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:36.725940 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-afd8c4bb-5260-42a7-ae99-d6d38fa31fb6 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 200 len: 1314 microversion: 2.1 time: 0.545589 Apr 08 02:56:36.727124 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 446/909] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:36 2022] GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:56:36.940722 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-33779229-979c-4f74-b17e-6c45d0ae9131 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "POST /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c/action" status: 202 len: 0 microversion: 2.1 time: 0.814312 Apr 08 02:56:36.945295 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 464/910] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Apr 8 02:56:36 2022] POST /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c/action => generated 0 bytes in 816 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:56:36.953197 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0067b74c-cdb8-472f-9230-f2de6b66e389 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:36.958238 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0067b74c-cdb8-472f-9230-f2de6b66e389 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:36.958418 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-880dcc4f-30d9-4998-9c51-05d9aa9338fc req-b2e915eb-fee9-40dc-b663-2088e755c379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeb2b2fc-3410-4860-a03b-cab8c080197c", "tag": "c585c168-7e51-4ca1-8f45-2f19dde4b67a"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:36.960068 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:56:36.960068 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:56:36.973844 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-880dcc4f-30d9-4998-9c51-05d9aa9338fc req-b2e915eb-fee9-40dc-b663-2088e755c379 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:36.974516 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-880dcc4f-30d9-4998-9c51-05d9aa9338fc req-b2e915eb-fee9-40dc-b663-2088e755c379 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:36.975086 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0067b74c-cdb8-472f-9230-f2de6b66e389 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:36.975541 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0067b74c-cdb8-472f-9230-f2de6b66e389 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:36.976439 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0067b74c-cdb8-472f-9230-f2de6b66e389 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:36.976876 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0067b74c-cdb8-472f-9230-f2de6b66e389 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:36.996442 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-880dcc4f-30d9-4998-9c51-05d9aa9338fc req-b2e915eb-fee9-40dc-b663-2088e755c379 service nova] Creating event network-changed:c585c168-7e51-4ca1-8f45-2f19dde4b67a for instance aeb2b2fc-3410-4860-a03b-cab8c080197c on hv-cinder-83705 Apr 08 02:56:37.002739 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-880dcc4f-30d9-4998-9c51-05d9aa9338fc req-b2e915eb-fee9-40dc-b663-2088e755c379 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051053 Apr 08 02:56:37.003855 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 447/911] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:37.208064 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0067b74c-cdb8-472f-9230-f2de6b66e389 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:37.218462 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0067b74c-cdb8-472f-9230-f2de6b66e389 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1760 microversion: 2.1 time: 0.271019 Apr 08 02:56:37.219026 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 465/912] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:36 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1760 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:37.746369 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ac254a0b-1130-4f19-bf57-d3523f983689 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:37.747779 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ac254a0b-1130-4f19-bf57-d3523f983689 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:37.765776 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ac254a0b-1130-4f19-bf57-d3523f983689 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:37.766568 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ac254a0b-1130-4f19-bf57-d3523f983689 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:37.767750 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ac254a0b-1130-4f19-bf57-d3523f983689 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:37.768412 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ac254a0b-1130-4f19-bf57-d3523f983689 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:38.063823 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ac254a0b-1130-4f19-bf57-d3523f983689 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:38.072399 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ac254a0b-1130-4f19-bf57-d3523f983689 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 200 len: 1314 microversion: 2.1 time: 0.331130 Apr 08 02:56:38.073648 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 448/913] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:37 2022] GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:39.090657 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5eb90db2-98a5-433f-946f-0d26c6280b5f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:39.091851 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5eb90db2-98a5-433f-946f-0d26c6280b5f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:39.099472 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5eb90db2-98a5-433f-946f-0d26c6280b5f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:39.099911 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5eb90db2-98a5-433f-946f-0d26c6280b5f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:39.100701 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5eb90db2-98a5-433f-946f-0d26c6280b5f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:39.101307 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5eb90db2-98a5-433f-946f-0d26c6280b5f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:39.309639 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5eb90db2-98a5-433f-946f-0d26c6280b5f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:39.318567 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5eb90db2-98a5-433f-946f-0d26c6280b5f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 200 len: 1314 microversion: 2.1 time: 0.231817 Apr 08 02:56:39.319135 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 466/914] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:39 2022] GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:40.335830 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-435ebc76-dc2d-4349-9cb9-c53e5554e407 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:40.336569 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-435ebc76-dc2d-4349-9cb9-c53e5554e407 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:40.344312 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-435ebc76-dc2d-4349-9cb9-c53e5554e407 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:40.344838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-435ebc76-dc2d-4349-9cb9-c53e5554e407 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:40.345737 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-435ebc76-dc2d-4349-9cb9-c53e5554e407 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:40.346303 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-435ebc76-dc2d-4349-9cb9-c53e5554e407 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:40.556013 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-435ebc76-dc2d-4349-9cb9-c53e5554e407 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:40.565426 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-435ebc76-dc2d-4349-9cb9-c53e5554e407 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 200 len: 1314 microversion: 2.1 time: 0.233207 Apr 08 02:56:40.566393 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 449/915] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:40 2022] GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:41.565327 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-29a66ce5-9fb3-4b6c-adc3-8a0ad78651a9 req-bcff172a-3f70-4f62-871a-18677d7fd82b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d749573-0c49-4eda-98d4-9574a85913d2", "name": "network-vif-plugged", "status": "completed", "tag": "0581239e-a8d6-45ea-8e72-865ca68115b2"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:41.568479 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:56:41.568479 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:56:41.580060 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-29a66ce5-9fb3-4b6c-adc3-8a0ad78651a9 req-bcff172a-3f70-4f62-871a-18677d7fd82b service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:41.580856 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-29a66ce5-9fb3-4b6c-adc3-8a0ad78651a9 req-bcff172a-3f70-4f62-871a-18677d7fd82b service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:41.583229 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2a2801c7-7e72-467e-9143-4061da9e996f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:41.584503 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2a2801c7-7e72-467e-9143-4061da9e996f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:41.592944 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2a2801c7-7e72-467e-9143-4061da9e996f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:41.593656 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2a2801c7-7e72-467e-9143-4061da9e996f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:41.594607 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2a2801c7-7e72-467e-9143-4061da9e996f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:41.595302 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2a2801c7-7e72-467e-9143-4061da9e996f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:41.601852 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-29a66ce5-9fb3-4b6c-adc3-8a0ad78651a9 req-bcff172a-3f70-4f62-871a-18677d7fd82b service nova] Creating event network-vif-plugged:0581239e-a8d6-45ea-8e72-865ca68115b2 for instance 4d749573-0c49-4eda-98d4-9574a85913d2 on hv-cinder-83705 Apr 08 02:56:41.607442 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-29a66ce5-9fb3-4b6c-adc3-8a0ad78651a9 req-bcff172a-3f70-4f62-871a-18677d7fd82b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047006 Apr 08 02:56:41.608376 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 467/916] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:41.813708 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2a2801c7-7e72-467e-9143-4061da9e996f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:41.821918 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2a2801c7-7e72-467e-9143-4061da9e996f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 200 len: 1314 microversion: 2.1 time: 0.243172 Apr 08 02:56:41.823070 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 450/917] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:41 2022] GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:42.840892 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5a965838-654a-4a55-b454-31cdd68bde4b tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:42.841587 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5a965838-654a-4a55-b454-31cdd68bde4b tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:42.849052 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5a965838-654a-4a55-b454-31cdd68bde4b tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:42.849501 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5a965838-654a-4a55-b454-31cdd68bde4b tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:42.850259 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5a965838-654a-4a55-b454-31cdd68bde4b tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:42.850692 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5a965838-654a-4a55-b454-31cdd68bde4b tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:43.047384 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5a965838-654a-4a55-b454-31cdd68bde4b tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:43.055377 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5a965838-654a-4a55-b454-31cdd68bde4b tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 200 len: 1314 microversion: 2.1 time: 0.219345 Apr 08 02:56:43.055914 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 468/918] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:42 2022] GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:44.072702 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-cc306fab-4d3f-4a37-8c94-e995c84b6094 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:44.073245 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-cc306fab-4d3f-4a37-8c94-e995c84b6094 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:44.080380 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cc306fab-4d3f-4a37-8c94-e995c84b6094 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:44.080824 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cc306fab-4d3f-4a37-8c94-e995c84b6094 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:44.081587 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cc306fab-4d3f-4a37-8c94-e995c84b6094 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:44.082021 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cc306fab-4d3f-4a37-8c94-e995c84b6094 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:44.277647 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-cc306fab-4d3f-4a37-8c94-e995c84b6094 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:44.285704 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-cc306fab-4d3f-4a37-8c94-e995c84b6094 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 200 len: 1497 microversion: 2.1 time: 0.216824 Apr 08 02:56:44.286265 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 451/919] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:44 2022] GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 1497 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:44.950528 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-2d9e92be-2fe3-4ffc-8398-0021493f2d48 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:44.951047 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2d9e92be-2fe3-4ffc-8398-0021493f2d48 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:44.958186 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2d9e92be-2fe3-4ffc-8398-0021493f2d48 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:44.958638 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2d9e92be-2fe3-4ffc-8398-0021493f2d48 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:44.959410 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2d9e92be-2fe3-4ffc-8398-0021493f2d48 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:44.959854 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-2d9e92be-2fe3-4ffc-8398-0021493f2d48 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:45.020652 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-2d9e92be-2fe3-4ffc-8398-0021493f2d48 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Going to try to terminate instance {{(pid=101272) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:56:45.138164 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-2d9e92be-2fe3-4ffc-8398-0021493f2d48 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 204 len: 0 microversion: 2.1 time: 0.191816 Apr 08 02:56:45.141927 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 469/920] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:56:44 2022] DELETE /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:56:45.146907 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-daa8a788-66eb-404a-bf5e-2083bff53f92 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:45.147456 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-daa8a788-66eb-404a-bf5e-2083bff53f92 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:45.155340 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-daa8a788-66eb-404a-bf5e-2083bff53f92 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:45.155683 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-daa8a788-66eb-404a-bf5e-2083bff53f92 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:45.156483 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-daa8a788-66eb-404a-bf5e-2083bff53f92 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:45.156922 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-daa8a788-66eb-404a-bf5e-2083bff53f92 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:45.377405 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-daa8a788-66eb-404a-bf5e-2083bff53f92 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:45.385845 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-daa8a788-66eb-404a-bf5e-2083bff53f92 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 200 len: 1503 microversion: 2.1 time: 0.242736 Apr 08 02:56:45.386401 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 452/921] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:45 2022] GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:46.403481 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f199b523-6ce3-4611-b720-d6de216be121 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:46.404269 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f199b523-6ce3-4611-b720-d6de216be121 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:46.411324 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f199b523-6ce3-4611-b720-d6de216be121 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:46.411756 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f199b523-6ce3-4611-b720-d6de216be121 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:46.412561 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f199b523-6ce3-4611-b720-d6de216be121 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:46.413000 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f199b523-6ce3-4611-b720-d6de216be121 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:46.620151 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f199b523-6ce3-4611-b720-d6de216be121 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:46.628578 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f199b523-6ce3-4611-b720-d6de216be121 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 200 len: 1503 microversion: 2.1 time: 0.229660 Apr 08 02:56:46.629135 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 470/922] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:46 2022] GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:47.646240 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-63654ff1-6d35-4c74-9042-8681531c27cc tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:47.646963 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-63654ff1-6d35-4c74-9042-8681531c27cc tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:47.654574 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-63654ff1-6d35-4c74-9042-8681531c27cc tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:47.655028 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-63654ff1-6d35-4c74-9042-8681531c27cc tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:47.655795 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-63654ff1-6d35-4c74-9042-8681531c27cc tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:47.656282 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-63654ff1-6d35-4c74-9042-8681531c27cc tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:47.671788 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-24ca9c24-3c0f-4738-95aa-c1508831ef03 req-6c226639-df12-4682-8bdd-97f76292bcbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d749573-0c49-4eda-98d4-9574a85913d2", "name": "network-vif-deleted", "tag": "0581239e-a8d6-45ea-8e72-865ca68115b2"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:47.673386 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:56:47.673386 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:56:47.690547 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-24ca9c24-3c0f-4738-95aa-c1508831ef03 req-6c226639-df12-4682-8bdd-97f76292bcbb service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:47.691017 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-24ca9c24-3c0f-4738-95aa-c1508831ef03 req-6c226639-df12-4682-8bdd-97f76292bcbb service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:47.711670 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-24ca9c24-3c0f-4738-95aa-c1508831ef03 req-6c226639-df12-4682-8bdd-97f76292bcbb service nova] Creating event network-vif-deleted:0581239e-a8d6-45ea-8e72-865ca68115b2 for instance 4d749573-0c49-4eda-98d4-9574a85913d2 on hv-cinder-83705 Apr 08 02:56:47.716575 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-24ca9c24-3c0f-4738-95aa-c1508831ef03 req-6c226639-df12-4682-8bdd-97f76292bcbb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048312 Apr 08 02:56:47.717172 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 471/923] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:47.814850 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-63654ff1-6d35-4c74-9042-8681531c27cc tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:47.823496 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-63654ff1-6d35-4c74-9042-8681531c27cc tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 200 len: 1461 microversion: 2.1 time: 0.180959 Apr 08 02:56:47.824337 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 453/924] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:47 2022] GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 1461 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:48.842527 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ab460e14-f58b-4e49-a608-be9f765e5d70 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:48.843323 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ab460e14-f58b-4e49-a608-be9f765e5d70 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: 4d749573-0c49-4eda-98d4-9574a85913d2] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:48.851230 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ab460e14-f58b-4e49-a608-be9f765e5d70 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:48.851849 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ab460e14-f58b-4e49-a608-be9f765e5d70 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:48.852671 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ab460e14-f58b-4e49-a608-be9f765e5d70 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:48.853106 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ab460e14-f58b-4e49-a608-be9f765e5d70 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:48.905544 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-ab460e14-f58b-4e49-a608-be9f765e5d70 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] HTTP exception thrown: Instance 4d749573-0c49-4eda-98d4-9574a85913d2 could not be found. Apr 08 02:56:48.906181 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ab460e14-f58b-4e49-a608-be9f765e5d70 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Returning 404 to user: Instance 4d749573-0c49-4eda-98d4-9574a85913d2 could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:56:48.907020 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ab460e14-f58b-4e49-a608-be9f765e5d70 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2" status: 404 len: 111 microversion: 2.1 time: 0.069122 Apr 08 02:56:48.907572 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 472/925] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:48 2022] GET /compute/v2.1/servers/4d749573-0c49-4eda-98d4-9574a85913d2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:49.015567 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5ef0be25-7bb9-44aa-b102-2654db0f526d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1027557692", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452", "networks": [{"uuid": "3024fc83-767b-4251-9cc8-eb502c5ce4a5"}]}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:49.079068 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.network.neutron [None req-5ef0be25-7bb9-44aa-b102-2654db0f526d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] validate_networks() for [('3024fc83-767b-4251-9cc8-eb502c5ce4a5', None, None, None)] {{(pid=101271) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:56:49.671520 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-5ef0be25-7bb9-44aa-b102-2654db0f526d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Flavor limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:56:49.671962 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-5ef0be25-7bb9-44aa-b102-2654db0f526d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Image limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:56:49.672442 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-5ef0be25-7bb9-44aa-b102-2654db0f526d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Flavor pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:56:49.672851 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-5ef0be25-7bb9-44aa-b102-2654db0f526d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Image pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:56:49.673261 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-5ef0be25-7bb9-44aa-b102-2654db0f526d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:56:49.682370 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5ef0be25-7bb9-44aa-b102-2654db0f526d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:49.683070 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5ef0be25-7bb9-44aa-b102-2654db0f526d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:49.683872 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5ef0be25-7bb9-44aa-b102-2654db0f526d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:49.684366 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5ef0be25-7bb9-44aa-b102-2654db0f526d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:49.701189 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-5ef0be25-7bb9-44aa-b102-2654db0f526d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Getting quotas for project 9e2629ed0483482588959ec1e5f818af. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:56:49.705278 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-5ef0be25-7bb9-44aa-b102-2654db0f526d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Getting quotas for user 4c73a12c1b6749b3882b510aef5cabe3 and project 9e2629ed0483482588959ec1e5f818af. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:56:49.716184 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-5ef0be25-7bb9-44aa-b102-2654db0f526d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Going to run 1 instances... {{(pid=101271) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:56:49.718459 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-5ef0be25-7bb9-44aa-b102-2654db0f526d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:56:49.763630 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-5ef0be25-7bb9-44aa-b102-2654db0f526d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751617 Apr 08 02:56:49.764235 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 454/926] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:56:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 02:56:49.774063 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d66945dc-45ca-44b9-860c-9f07c9637587 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:49.774683 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d66945dc-45ca-44b9-860c-9f07c9637587 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:49.843132 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d66945dc-45ca-44b9-860c-9f07c9637587 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:49.852268 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d66945dc-45ca-44b9-860c-9f07c9637587 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 200 len: 1214 microversion: 2.1 time: 0.081760 Apr 08 02:56:49.852834 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 473/927] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:49 2022] GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:50.870460 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c9f6b6e2-6f5a-4094-8484-bc74c5514a69 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:50.871067 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c9f6b6e2-6f5a-4094-8484-bc74c5514a69 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:50.879037 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c9f6b6e2-6f5a-4094-8484-bc74c5514a69 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:50.879782 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c9f6b6e2-6f5a-4094-8484-bc74c5514a69 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:50.880679 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c9f6b6e2-6f5a-4094-8484-bc74c5514a69 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:50.881193 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c9f6b6e2-6f5a-4094-8484-bc74c5514a69 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:51.023844 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c9f6b6e2-6f5a-4094-8484-bc74c5514a69 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:51.032307 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c9f6b6e2-6f5a-4094-8484-bc74c5514a69 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 200 len: 1284 microversion: 2.1 time: 0.166225 Apr 08 02:56:51.032871 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 455/928] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:50 2022] GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 1284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:52.049390 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5f4517c8-cb4d-4f9f-8b5d-cd7be4a69f81 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:52.050046 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5f4517c8-cb4d-4f9f-8b5d-cd7be4a69f81 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:52.058644 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5f4517c8-cb4d-4f9f-8b5d-cd7be4a69f81 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:52.059096 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5f4517c8-cb4d-4f9f-8b5d-cd7be4a69f81 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:52.059872 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5f4517c8-cb4d-4f9f-8b5d-cd7be4a69f81 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:52.060332 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5f4517c8-cb4d-4f9f-8b5d-cd7be4a69f81 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:52.255027 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5f4517c8-cb4d-4f9f-8b5d-cd7be4a69f81 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:52.263840 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5f4517c8-cb4d-4f9f-8b5d-cd7be4a69f81 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 200 len: 1314 microversion: 2.1 time: 0.218259 Apr 08 02:56:52.264438 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 474/929] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:52 2022] GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:52.736382 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-81b36b21-f0a9-4ae7-b8ed-cca057897846 req-90787556-cef7-46bf-ac96-448675bd3753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5a13de-b322-48eb-8a49-dd20b13cef08", "tag": "7a62cde7-d56d-4281-80ba-1728ab0410ea"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:52.738907 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:56:52.738907 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:56:52.748791 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-81b36b21-f0a9-4ae7-b8ed-cca057897846 req-90787556-cef7-46bf-ac96-448675bd3753 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:52.749647 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-81b36b21-f0a9-4ae7-b8ed-cca057897846 req-90787556-cef7-46bf-ac96-448675bd3753 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:52.765443 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-81b36b21-f0a9-4ae7-b8ed-cca057897846 req-90787556-cef7-46bf-ac96-448675bd3753 service nova] Creating event network-changed:7a62cde7-d56d-4281-80ba-1728ab0410ea for instance ce5a13de-b322-48eb-8a49-dd20b13cef08 on hv-cinder-83705 Apr 08 02:56:52.771104 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-81b36b21-f0a9-4ae7-b8ed-cca057897846 req-90787556-cef7-46bf-ac96-448675bd3753 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044535 Apr 08 02:56:52.772320 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 456/930] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:53.282009 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-cce0787a-9292-470c-a985-7af3fa4056c2 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:53.282672 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-cce0787a-9292-470c-a985-7af3fa4056c2 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:53.291775 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cce0787a-9292-470c-a985-7af3fa4056c2 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:53.292234 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cce0787a-9292-470c-a985-7af3fa4056c2 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:53.293010 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cce0787a-9292-470c-a985-7af3fa4056c2 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:53.293450 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cce0787a-9292-470c-a985-7af3fa4056c2 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:53.546415 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cce0787a-9292-470c-a985-7af3fa4056c2 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:53.551543 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-cce0787a-9292-470c-a985-7af3fa4056c2 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 200 len: 1314 microversion: 2.1 time: 0.273016 Apr 08 02:56:53.552321 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 475/931] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:53 2022] GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:54.572759 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4047c70b-2a25-4177-9651-4ceef8c6d548 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:54.573521 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-4047c70b-2a25-4177-9651-4ceef8c6d548 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:54.581949 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4047c70b-2a25-4177-9651-4ceef8c6d548 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:54.582399 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4047c70b-2a25-4177-9651-4ceef8c6d548 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:54.583398 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4047c70b-2a25-4177-9651-4ceef8c6d548 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:54.584069 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4047c70b-2a25-4177-9651-4ceef8c6d548 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:54.825607 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4047c70b-2a25-4177-9651-4ceef8c6d548 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:54.837093 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4047c70b-2a25-4177-9651-4ceef8c6d548 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 200 len: 1314 microversion: 2.1 time: 0.269107 Apr 08 02:56:54.838035 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 457/932] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:54 2022] GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:56:55.855076 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-26b01012-fea9-4c91-be8b-603af0b7eda0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:55.856031 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-26b01012-fea9-4c91-be8b-603af0b7eda0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:55.863677 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-26b01012-fea9-4c91-be8b-603af0b7eda0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:55.864294 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-26b01012-fea9-4c91-be8b-603af0b7eda0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:55.865173 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-26b01012-fea9-4c91-be8b-603af0b7eda0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:55.865751 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-26b01012-fea9-4c91-be8b-603af0b7eda0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:56.239022 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-26b01012-fea9-4c91-be8b-603af0b7eda0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:56.247680 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-26b01012-fea9-4c91-be8b-603af0b7eda0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 200 len: 1314 microversion: 2.1 time: 0.397587 Apr 08 02:56:56.248423 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 476/933] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:55 2022] GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:57.265879 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b4b397e1-d488-41ff-becd-d62bb6f6872f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:57.267272 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b4b397e1-d488-41ff-becd-d62bb6f6872f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:57.276565 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b4b397e1-d488-41ff-becd-d62bb6f6872f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:57.277012 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b4b397e1-d488-41ff-becd-d62bb6f6872f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:57.277784 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b4b397e1-d488-41ff-becd-d62bb6f6872f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:57.278400 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b4b397e1-d488-41ff-becd-d62bb6f6872f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:57.512411 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b4b397e1-d488-41ff-becd-d62bb6f6872f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:57.521298 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b4b397e1-d488-41ff-becd-d62bb6f6872f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 200 len: 1314 microversion: 2.1 time: 0.259209 Apr 08 02:56:57.535573 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 458/934] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:57 2022] GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:58.540357 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c9676d03-22f3-4ad3-90d2-9a541270b541 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:58.541884 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c9676d03-22f3-4ad3-90d2-9a541270b541 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:58.549267 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c9676d03-22f3-4ad3-90d2-9a541270b541 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:58.549786 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c9676d03-22f3-4ad3-90d2-9a541270b541 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:58.550622 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c9676d03-22f3-4ad3-90d2-9a541270b541 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:58.551122 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c9676d03-22f3-4ad3-90d2-9a541270b541 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:58.761565 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c9676d03-22f3-4ad3-90d2-9a541270b541 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:56:58.770018 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c9676d03-22f3-4ad3-90d2-9a541270b541 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 200 len: 1314 microversion: 2.1 time: 0.233723 Apr 08 02:56:58.781322 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 477/935] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:58 2022] GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:59.786663 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2117fce7-8b18-4f24-909b-4f04fb18dafd tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:59.787272 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2117fce7-8b18-4f24-909b-4f04fb18dafd tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:56:59.795596 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2117fce7-8b18-4f24-909b-4f04fb18dafd tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:59.796083 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2117fce7-8b18-4f24-909b-4f04fb18dafd tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:59.796861 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2117fce7-8b18-4f24-909b-4f04fb18dafd tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:59.797295 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2117fce7-8b18-4f24-909b-4f04fb18dafd tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:00.445077 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2117fce7-8b18-4f24-909b-4f04fb18dafd tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:00.454349 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2117fce7-8b18-4f24-909b-4f04fb18dafd tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 200 len: 1314 microversion: 2.1 time: 0.671329 Apr 08 02:57:00.455126 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 459/936] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:59 2022] GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:01.470551 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-74090fa8-6129-4027-9f3e-360ee989ac04 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:01.471846 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-74090fa8-6129-4027-9f3e-360ee989ac04 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:01.481009 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-74090fa8-6129-4027-9f3e-360ee989ac04 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:01.481650 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-74090fa8-6129-4027-9f3e-360ee989ac04 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:01.482634 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-74090fa8-6129-4027-9f3e-360ee989ac04 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:01.483236 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-74090fa8-6129-4027-9f3e-360ee989ac04 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:01.856973 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-74090fa8-6129-4027-9f3e-360ee989ac04 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:01.866826 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-74090fa8-6129-4027-9f3e-360ee989ac04 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 200 len: 1314 microversion: 2.1 time: 0.400022 Apr 08 02:57:01.867401 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 478/937] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:01 2022] GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:01.896743 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-f969344d-f752-4cba-a03a-5afb885cdf6b req-793d9e53-ec3e-4e6e-b47a-05447c6774a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5a13de-b322-48eb-8a49-dd20b13cef08", "name": "network-vif-plugged", "status": "completed", "tag": "7a62cde7-d56d-4281-80ba-1728ab0410ea"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:01.898598 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:01.898598 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:57:01.908154 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-f969344d-f752-4cba-a03a-5afb885cdf6b req-793d9e53-ec3e-4e6e-b47a-05447c6774a5 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:01.908599 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-f969344d-f752-4cba-a03a-5afb885cdf6b req-793d9e53-ec3e-4e6e-b47a-05447c6774a5 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:01.937310 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-f969344d-f752-4cba-a03a-5afb885cdf6b req-793d9e53-ec3e-4e6e-b47a-05447c6774a5 service nova] Creating event network-vif-plugged:7a62cde7-d56d-4281-80ba-1728ab0410ea for instance ce5a13de-b322-48eb-8a49-dd20b13cef08 on hv-cinder-83705 Apr 08 02:57:01.944945 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-f969344d-f752-4cba-a03a-5afb885cdf6b req-793d9e53-ec3e-4e6e-b47a-05447c6774a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050902 Apr 08 02:57:01.947028 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 460/938] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:57:02.888328 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-95de73dc-e431-48b9-a70f-dd8f89d3a587 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:02.889665 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-95de73dc-e431-48b9-a70f-dd8f89d3a587 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:02.901198 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-95de73dc-e431-48b9-a70f-dd8f89d3a587 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:02.902258 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-95de73dc-e431-48b9-a70f-dd8f89d3a587 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:02.903618 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-95de73dc-e431-48b9-a70f-dd8f89d3a587 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:02.904330 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-95de73dc-e431-48b9-a70f-dd8f89d3a587 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:03.285462 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-95de73dc-e431-48b9-a70f-dd8f89d3a587 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:03.296273 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-95de73dc-e431-48b9-a70f-dd8f89d3a587 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 200 len: 1314 microversion: 2.1 time: 0.413827 Apr 08 02:57:03.308126 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 479/939] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:02 2022] GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:04.314129 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-053e2302-e31f-4296-9603-1f3750e85bc0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:04.315465 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-053e2302-e31f-4296-9603-1f3750e85bc0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:04.323939 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-053e2302-e31f-4296-9603-1f3750e85bc0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:04.324617 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-053e2302-e31f-4296-9603-1f3750e85bc0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:04.325572 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-053e2302-e31f-4296-9603-1f3750e85bc0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:04.326190 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-053e2302-e31f-4296-9603-1f3750e85bc0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:04.583176 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-053e2302-e31f-4296-9603-1f3750e85bc0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:04.592874 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-053e2302-e31f-4296-9603-1f3750e85bc0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 200 len: 1498 microversion: 2.1 time: 0.282806 Apr 08 02:57:04.593450 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 461/940] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:04 2022] GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 1498 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:05.424838 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f544c7c1-9e96-483b-a157-d94765c71bd1 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:05.425416 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f544c7c1-9e96-483b-a157-d94765c71bd1 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:05.433053 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f544c7c1-9e96-483b-a157-d94765c71bd1 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:05.433501 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f544c7c1-9e96-483b-a157-d94765c71bd1 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:05.434273 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f544c7c1-9e96-483b-a157-d94765c71bd1 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:05.434709 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f544c7c1-9e96-483b-a157-d94765c71bd1 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:05.498795 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f544c7c1-9e96-483b-a157-d94765c71bd1 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Going to try to terminate instance {{(pid=101272) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:57:05.630044 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f544c7c1-9e96-483b-a157-d94765c71bd1 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 204 len: 0 microversion: 2.1 time: 0.208439 Apr 08 02:57:05.632170 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 480/941] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:57:05 2022] DELETE /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:57:05.640528 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-842ee189-467a-45f1-9ea4-8e9b6153800f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:05.641923 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-842ee189-467a-45f1-9ea4-8e9b6153800f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:05.650888 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-842ee189-467a-45f1-9ea4-8e9b6153800f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:05.651733 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-842ee189-467a-45f1-9ea4-8e9b6153800f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:05.652764 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-842ee189-467a-45f1-9ea4-8e9b6153800f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:05.653366 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-842ee189-467a-45f1-9ea4-8e9b6153800f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:05.873030 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-842ee189-467a-45f1-9ea4-8e9b6153800f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:05.884488 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-842ee189-467a-45f1-9ea4-8e9b6153800f tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 200 len: 1504 microversion: 2.1 time: 0.247688 Apr 08 02:57:05.885368 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 462/942] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:05 2022] GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:57:06.904023 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-a84fea71-a76b-4365-aca9-d35f646cf517 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:06.904638 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-a84fea71-a76b-4365-aca9-d35f646cf517 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:06.912214 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a84fea71-a76b-4365-aca9-d35f646cf517 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:06.913050 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a84fea71-a76b-4365-aca9-d35f646cf517 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:06.913873 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a84fea71-a76b-4365-aca9-d35f646cf517 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:06.914309 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a84fea71-a76b-4365-aca9-d35f646cf517 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:07.637315 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a84fea71-a76b-4365-aca9-d35f646cf517 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:07.645691 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-a84fea71-a76b-4365-aca9-d35f646cf517 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 200 len: 1504 microversion: 2.1 time: 0.746897 Apr 08 02:57:07.646581 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 481/943] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:06 2022] GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 1504 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:08.106952 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8fb5056f-dfc5-4943-ba5f-8972fccc5c02 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Action: 'create', calling method: .version_select at 0x7fbc3910e4c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1326577827"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:08.131944 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-8fb5056f-dfc5-4943-ba5f-8972fccc5c02 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Getting quotas for project c0b956e0c3a74df8890d564dadb5ad70. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:57:08.136546 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-8fb5056f-dfc5-4943-ba5f-8972fccc5c02 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Getting quotas for user 8df441c38c604f1487efba726a41d411 and project c0b956e0c3a74df8890d564dadb5ad70. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:57:08.303838 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-1093c95a-b472-47e8-8fb4-cb0d42979374 req-ca174adb-ab78-4593-b2ea-d9c18ff02135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5a13de-b322-48eb-8a49-dd20b13cef08", "name": "network-vif-deleted", "tag": "7a62cde7-d56d-4281-80ba-1728ab0410ea"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:08.305416 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:08.305416 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:57:08.318592 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-1093c95a-b472-47e8-8fb4-cb0d42979374 req-ca174adb-ab78-4593-b2ea-d9c18ff02135 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:08.319192 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-1093c95a-b472-47e8-8fb4-cb0d42979374 req-ca174adb-ab78-4593-b2ea-d9c18ff02135 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:08.330438 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-8fb5056f-dfc5-4943-ba5f-8972fccc5c02 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Getting quotas for project c0b956e0c3a74df8890d564dadb5ad70. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:57:08.335677 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-8fb5056f-dfc5-4943-ba5f-8972fccc5c02 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Getting quotas for user 8df441c38c604f1487efba726a41d411 and project c0b956e0c3a74df8890d564dadb5ad70. Resources: {'key_pairs'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:57:08.339470 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-1093c95a-b472-47e8-8fb4-cb0d42979374 req-ca174adb-ab78-4593-b2ea-d9c18ff02135 service nova] Creating event network-vif-deleted:7a62cde7-d56d-4281-80ba-1728ab0410ea for instance ce5a13de-b322-48eb-8a49-dd20b13cef08 on hv-cinder-83705 Apr 08 02:57:08.344586 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-1093c95a-b472-47e8-8fb4-cb0d42979374 req-ca174adb-ab78-4593-b2ea-d9c18ff02135 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045264 Apr 08 02:57:08.345324 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 482/944] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:57:08.354866 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8fb5056f-dfc5-4943-ba5f-8972fccc5c02 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.451865 Apr 08 02:57:08.355462 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 463/945] 10.222.0.23 () {60 vars in 1157 bytes} [Fri Apr 8 02:57:07 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:08.663065 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f92ebc3a-4e26-4a93-8f8b-66075de0b00d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:08.664045 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f92ebc3a-4e26-4a93-8f8b-66075de0b00d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:08.674671 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f92ebc3a-4e26-4a93-8f8b-66075de0b00d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:08.675125 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f92ebc3a-4e26-4a93-8f8b-66075de0b00d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:08.675910 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f92ebc3a-4e26-4a93-8f8b-66075de0b00d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:08.676374 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f92ebc3a-4e26-4a93-8f8b-66075de0b00d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:08.764891 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f92ebc3a-4e26-4a93-8f8b-66075de0b00d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:08.765510 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f92ebc3a-4e26-4a93-8f8b-66075de0b00d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:08.766060 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.objects.instance [None req-f92ebc3a-4e26-4a93-8f8b-66075de0b00d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lazy-loading 'fault' on Instance uuid ce5a13de-b322-48eb-8a49-dd20b13cef08 {{(pid=101272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:57:08.849102 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f92ebc3a-4e26-4a93-8f8b-66075de0b00d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c73a12c1b6749b3882b510aef5cabe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2629ed0483482588959ec1e5f818af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:08.859746 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f92ebc3a-4e26-4a93-8f8b-66075de0b00d tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 200 len: 1304 microversion: 2.1 time: 0.200652 Apr 08 02:57:08.860534 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 483/946] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:08 2022] GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 1304 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:09.877995 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fb2d8a79-3247-442e-90d1-50d682ec8ac0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:09.878607 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-fb2d8a79-3247-442e-90d1-50d682ec8ac0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] [instance: ce5a13de-b322-48eb-8a49-dd20b13cef08] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:09.886952 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb2d8a79-3247-442e-90d1-50d682ec8ac0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:09.887402 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb2d8a79-3247-442e-90d1-50d682ec8ac0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:09.888195 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb2d8a79-3247-442e-90d1-50d682ec8ac0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:09.888629 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb2d8a79-3247-442e-90d1-50d682ec8ac0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:09.938480 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-fb2d8a79-3247-442e-90d1-50d682ec8ac0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] HTTP exception thrown: Instance ce5a13de-b322-48eb-8a49-dd20b13cef08 could not be found. Apr 08 02:57:09.939081 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fb2d8a79-3247-442e-90d1-50d682ec8ac0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] Returning 404 to user: Instance ce5a13de-b322-48eb-8a49-dd20b13cef08 could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:57:09.939903 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-fb2d8a79-3247-442e-90d1-50d682ec8ac0 tempest-VolumesActionsTest-330477643 tempest-VolumesActionsTest-330477643-project] 10.222.0.23 "GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08" status: 404 len: 111 microversion: 2.1 time: 0.065919 Apr 08 02:57:09.940462 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 464/947] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:09 2022] GET /compute/v2.1/servers/ce5a13de-b322-48eb-8a49-dd20b13cef08 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:57:24.579838 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 02:57:24.579838 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: Fri Apr 8 02:57:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 02:57:31.757777 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c3145c13-4824-4968-a09f-f526ec28e9d3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:31.759013 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c3145c13-4824-4968-a09f-f526ec28e9d3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:31.769951 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c3145c13-4824-4968-a09f-f526ec28e9d3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:31.770794 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c3145c13-4824-4968-a09f-f526ec28e9d3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:31.772010 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c3145c13-4824-4968-a09f-f526ec28e9d3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:31.772446 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c3145c13-4824-4968-a09f-f526ec28e9d3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:31.943129 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c3145c13-4824-4968-a09f-f526ec28e9d3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "POST /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c/action" status: 202 len: 0 microversion: 2.1 time: 0.189738 Apr 08 02:57:31.947020 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 484/948] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Apr 8 02:57:31 2022] POST /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:57:31.955035 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-588cbf6b-149d-4766-ac5f-b770a1924cef tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:31.956362 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-588cbf6b-149d-4766-ac5f-b770a1924cef tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:31.968850 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-588cbf6b-149d-4766-ac5f-b770a1924cef tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:31.969568 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-588cbf6b-149d-4766-ac5f-b770a1924cef tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:31.970669 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-588cbf6b-149d-4766-ac5f-b770a1924cef tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:31.971370 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-588cbf6b-149d-4766-ac5f-b770a1924cef tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:32.397292 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-588cbf6b-149d-4766-ac5f-b770a1924cef tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:32.411438 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-588cbf6b-149d-4766-ac5f-b770a1924cef tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1752 microversion: 2.1 time: 0.462739 Apr 08 02:57:32.412169 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 465/949] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:31 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1752 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:33.429919 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-577820ef-ff74-4a6c-8547-b21b6addb89a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:33.430628 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-577820ef-ff74-4a6c-8547-b21b6addb89a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:33.441342 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-577820ef-ff74-4a6c-8547-b21b6addb89a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:33.442128 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-577820ef-ff74-4a6c-8547-b21b6addb89a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:33.443164 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-577820ef-ff74-4a6c-8547-b21b6addb89a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:33.443859 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-577820ef-ff74-4a6c-8547-b21b6addb89a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:33.685530 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-577820ef-ff74-4a6c-8547-b21b6addb89a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:33.694998 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-577820ef-ff74-4a6c-8547-b21b6addb89a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1757 microversion: 2.1 time: 0.269164 Apr 08 02:57:33.695737 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 485/950] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:33 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1757 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:34.714843 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-008d73b2-c1c3-40c1-bc2c-8b5fd2f8df19 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:34.715699 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-008d73b2-c1c3-40c1-bc2c-8b5fd2f8df19 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:34.724189 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-008d73b2-c1c3-40c1-bc2c-8b5fd2f8df19 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:34.724999 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-008d73b2-c1c3-40c1-bc2c-8b5fd2f8df19 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:34.725963 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-008d73b2-c1c3-40c1-bc2c-8b5fd2f8df19 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:34.726408 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-008d73b2-c1c3-40c1-bc2c-8b5fd2f8df19 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:34.994621 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-008d73b2-c1c3-40c1-bc2c-8b5fd2f8df19 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:35.013191 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-008d73b2-c1c3-40c1-bc2c-8b5fd2f8df19 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1757 microversion: 2.1 time: 0.302439 Apr 08 02:57:35.014730 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 466/951] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:34 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1757 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:35.641295 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c9316442-0f4d-4bd1-8d40-c3ab56e413d0 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1832690683", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1326577827", "security_groups": [{"name": "tempest-secgroup-smoke-1441768386"}], "block_device_mapping_v2": [{"uuid": "99463c61-ca3c-4507-bfd2-b4bb1ef0df48", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "21a17f5c-b124-484f-a29f-b582b1b5f383"}]}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:35.800963 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.network.neutron [None req-c9316442-0f4d-4bd1-8d40-c3ab56e413d0 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] validate_networks() for [('21a17f5c-b124-484f-a29f-b582b1b5f383', None, None, None)] {{(pid=101272) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:57:36.035293 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-ec888152-a25e-4d57-ab89-d773c75d0b83 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:36.035825 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-ec888152-a25e-4d57-ab89-d773c75d0b83 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:36.043036 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ec888152-a25e-4d57-ab89-d773c75d0b83 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:36.043482 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ec888152-a25e-4d57-ab89-d773c75d0b83 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:36.044423 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ec888152-a25e-4d57-ab89-d773c75d0b83 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:36.044847 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-ec888152-a25e-4d57-ab89-d773c75d0b83 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:36.249976 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-ec888152-a25e-4d57-ab89-d773c75d0b83 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:36.258584 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-ec888152-a25e-4d57-ab89-d773c75d0b83 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1757 microversion: 2.1 time: 0.227441 Apr 08 02:57:36.259149 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 467/952] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:36 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1757 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:57:36.342357 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-c9316442-0f4d-4bd1-8d40-c3ab56e413d0 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Flavor limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:57:36.342891 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-c9316442-0f4d-4bd1-8d40-c3ab56e413d0 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Image limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:57:36.343407 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-c9316442-0f4d-4bd1-8d40-c3ab56e413d0 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Flavor pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:57:36.343819 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-c9316442-0f4d-4bd1-8d40-c3ab56e413d0 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Image pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:57:36.344270 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-c9316442-0f4d-4bd1-8d40-c3ab56e413d0 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:57:36.352578 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c9316442-0f4d-4bd1-8d40-c3ab56e413d0 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:36.353025 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c9316442-0f4d-4bd1-8d40-c3ab56e413d0 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:36.353831 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c9316442-0f4d-4bd1-8d40-c3ab56e413d0 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:36.354265 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c9316442-0f4d-4bd1-8d40-c3ab56e413d0 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:36.371263 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-c9316442-0f4d-4bd1-8d40-c3ab56e413d0 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Getting quotas for project c0b956e0c3a74df8890d564dadb5ad70. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:57:36.375372 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-c9316442-0f4d-4bd1-8d40-c3ab56e413d0 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Getting quotas for user 8df441c38c604f1487efba726a41d411 and project c0b956e0c3a74df8890d564dadb5ad70. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:57:36.466501 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c9316442-0f4d-4bd1-8d40-c3ab56e413d0 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Going to run 1 instances... {{(pid=101272) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:57:36.468787 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c9316442-0f4d-4bd1-8d40-c3ab56e413d0 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='99463c61-ca3c-4507-bfd2-b4bb1ef0df48',volume_size=None,volume_type=None)] {{(pid=101272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:57:36.646772 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c9316442-0f4d-4bd1-8d40-c3ab56e413d0 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.008789 Apr 08 02:57:36.648342 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 486/953] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:57:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:57:36.658674 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d9609a5f-87f9-4807-942d-994a5aa5e8ea tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:36.659295 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-d9609a5f-87f9-4807-942d-994a5aa5e8ea tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:36.754166 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-d9609a5f-87f9-4807-942d-994a5aa5e8ea tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:36.762094 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-d9609a5f-87f9-4807-942d-994a5aa5e8ea tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1095 microversion: 2.1 time: 0.107071 Apr 08 02:57:36.763726 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 468/954] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:36 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1095 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:37.276151 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-fb12c70b-eb01-4d99-87eb-750bea1f55f2 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:37.276289 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-fb12c70b-eb01-4d99-87eb-750bea1f55f2 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:37.285030 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fb12c70b-eb01-4d99-87eb-750bea1f55f2 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:37.285481 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fb12c70b-eb01-4d99-87eb-750bea1f55f2 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:37.286257 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fb12c70b-eb01-4d99-87eb-750bea1f55f2 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:37.286688 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fb12c70b-eb01-4d99-87eb-750bea1f55f2 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:37.483397 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-fb12c70b-eb01-4d99-87eb-750bea1f55f2 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:37.492041 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-fb12c70b-eb01-4d99-87eb-750bea1f55f2 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1757 microversion: 2.1 time: 0.220251 Apr 08 02:57:37.492600 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 487/955] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:37 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1757 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:37.780799 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e3d0579d-67a7-4cbc-bd0b-f224572b3bf3 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:37.782004 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e3d0579d-67a7-4cbc-bd0b-f224572b3bf3 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:37.790093 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e3d0579d-67a7-4cbc-bd0b-f224572b3bf3 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:37.790546 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e3d0579d-67a7-4cbc-bd0b-f224572b3bf3 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:37.791323 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e3d0579d-67a7-4cbc-bd0b-f224572b3bf3 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:37.791758 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e3d0579d-67a7-4cbc-bd0b-f224572b3bf3 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:37.918844 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e3d0579d-67a7-4cbc-bd0b-f224572b3bf3 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:37.927361 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e3d0579d-67a7-4cbc-bd0b-f224572b3bf3 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1211 microversion: 2.1 time: 0.151064 Apr 08 02:57:37.927917 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 469/956] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:37 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1211 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:38.510200 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1a443a5a-f2fd-4bf9-9dd7-b5619502dfd9 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:38.512123 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1a443a5a-f2fd-4bf9-9dd7-b5619502dfd9 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:38.533008 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1a443a5a-f2fd-4bf9-9dd7-b5619502dfd9 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:38.533713 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1a443a5a-f2fd-4bf9-9dd7-b5619502dfd9 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:38.534870 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1a443a5a-f2fd-4bf9-9dd7-b5619502dfd9 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:38.535349 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1a443a5a-f2fd-4bf9-9dd7-b5619502dfd9 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:38.949060 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-87e0cc4c-2f16-4bf3-bb01-65f38778ca64 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:38.949869 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-87e0cc4c-2f16-4bf3-bb01-65f38778ca64 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:38.951864 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-1a443a5a-f2fd-4bf9-9dd7-b5619502dfd9 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:38.960788 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-87e0cc4c-2f16-4bf3-bb01-65f38778ca64 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:38.963333 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1a443a5a-f2fd-4bf9-9dd7-b5619502dfd9 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1757 microversion: 2.1 time: 0.457623 Apr 08 02:57:38.967204 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-87e0cc4c-2f16-4bf3-bb01-65f38778ca64 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:38.967892 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 488/957] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:38 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1757 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:38.968317 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-87e0cc4c-2f16-4bf3-bb01-65f38778ca64 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:38.968866 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-87e0cc4c-2f16-4bf3-bb01-65f38778ca64 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:39.413221 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-87e0cc4c-2f16-4bf3-bb01-65f38778ca64 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:39.422598 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-87e0cc4c-2f16-4bf3-bb01-65f38778ca64 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1267 microversion: 2.1 time: 0.481110 Apr 08 02:57:39.423274 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 470/958] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:38 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1267 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:39.993238 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-b75a28d4-b7ee-4555-930c-865694dd4753 req-dc0c2637-eb4e-499f-a756-3271704de7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b0931a-d15f-4ff6-bfc7-5490869d6892", "tag": "56f98f9e-78b0-44c5-8f41-7a79b4c6433b"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:39.994854 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:39.994854 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:57:40.000306 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-53edad1a-2b4a-45a4-9f57-f999b054e661 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:40.000981 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-53edad1a-2b4a-45a4-9f57-f999b054e661 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:40.021443 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-53edad1a-2b4a-45a4-9f57-f999b054e661 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:40.022298 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-53edad1a-2b4a-45a4-9f57-f999b054e661 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:40.025835 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-53edad1a-2b4a-45a4-9f57-f999b054e661 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:40.027447 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-53edad1a-2b4a-45a4-9f57-f999b054e661 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:40.027864 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-b75a28d4-b7ee-4555-930c-865694dd4753 req-dc0c2637-eb4e-499f-a756-3271704de7ff service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:40.031889 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-b75a28d4-b7ee-4555-930c-865694dd4753 req-dc0c2637-eb4e-499f-a756-3271704de7ff service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:40.075874 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-b75a28d4-b7ee-4555-930c-865694dd4753 req-dc0c2637-eb4e-499f-a756-3271704de7ff service nova] Creating event network-changed:56f98f9e-78b0-44c5-8f41-7a79b4c6433b for instance 00b0931a-d15f-4ff6-bfc7-5490869d6892 on hv-cinder-83705 Apr 08 02:57:40.087741 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-b75a28d4-b7ee-4555-930c-865694dd4753 req-dc0c2637-eb4e-499f-a756-3271704de7ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107078 Apr 08 02:57:40.089967 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 489/959] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:57:40.428912 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-53edad1a-2b4a-45a4-9f57-f999b054e661 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:40.439795 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-53edad1a-2b4a-45a4-9f57-f999b054e661 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1757 microversion: 2.1 time: 0.455519 Apr 08 02:57:40.440619 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 471/960] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:39 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1757 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:40.449632 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-6471fc95-d121-481e-8672-b524dfa2b275 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:40.449632 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-6471fc95-d121-481e-8672-b524dfa2b275 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:40.451062 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6471fc95-d121-481e-8672-b524dfa2b275 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:40.452542 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6471fc95-d121-481e-8672-b524dfa2b275 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:40.453601 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6471fc95-d121-481e-8672-b524dfa2b275 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:40.454396 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-6471fc95-d121-481e-8672-b524dfa2b275 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:40.825700 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-6471fc95-d121-481e-8672-b524dfa2b275 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:40.834144 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-6471fc95-d121-481e-8672-b524dfa2b275 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1267 microversion: 2.1 time: 0.397564 Apr 08 02:57:40.834700 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 490/961] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:40 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1267 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:57:41.456692 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a03b57dd-186f-4063-bb4d-5f0b89ad79ca tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:41.458100 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a03b57dd-186f-4063-bb4d-5f0b89ad79ca tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:41.467211 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a03b57dd-186f-4063-bb4d-5f0b89ad79ca tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:41.467903 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a03b57dd-186f-4063-bb4d-5f0b89ad79ca tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:41.468808 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a03b57dd-186f-4063-bb4d-5f0b89ad79ca tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:41.469343 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a03b57dd-186f-4063-bb4d-5f0b89ad79ca tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:41.852171 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-cb679051-0b6e-4788-b40b-5cbe11436f5b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:41.853330 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-cb679051-0b6e-4788-b40b-5cbe11436f5b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:41.862912 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cb679051-0b6e-4788-b40b-5cbe11436f5b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:41.863227 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a03b57dd-186f-4063-bb4d-5f0b89ad79ca tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:41.863530 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cb679051-0b6e-4788-b40b-5cbe11436f5b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:41.864415 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cb679051-0b6e-4788-b40b-5cbe11436f5b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:41.864861 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cb679051-0b6e-4788-b40b-5cbe11436f5b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:41.873410 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a03b57dd-186f-4063-bb4d-5f0b89ad79ca tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1757 microversion: 2.1 time: 0.420161 Apr 08 02:57:41.873973 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 472/962] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:41 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1757 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:42.065516 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cb679051-0b6e-4788-b40b-5cbe11436f5b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:42.073910 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-cb679051-0b6e-4788-b40b-5cbe11436f5b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1267 microversion: 2.1 time: 0.226288 Apr 08 02:57:42.074474 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 491/963] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:41 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:57:42.192328 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b53267ff-1228-41ef-8f16-14036dc09406 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-690556269", "imageRef": "8ee94749-244e-4e9a-babe-d75d31db807f", "flavorRef": "452"}} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:42.255503 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.network.neutron [None req-b53267ff-1228-41ef-8f16-14036dc09406 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] validate_networks() for None {{(pid=101271) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 02:57:42.506547 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-b53267ff-1228-41ef-8f16-14036dc09406 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Flavor limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 02:57:42.507131 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-b53267ff-1228-41ef-8f16-14036dc09406 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Image limits 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 02:57:42.507428 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-b53267ff-1228-41ef-8f16-14036dc09406 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Flavor pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 02:57:42.507836 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-b53267ff-1228-41ef-8f16-14036dc09406 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Image pref 0:0:0 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 02:57:42.508275 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.virt.hardware [None req-b53267ff-1228-41ef-8f16-14036dc09406 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 02:57:42.517703 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b53267ff-1228-41ef-8f16-14036dc09406 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:42.518141 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b53267ff-1228-41ef-8f16-14036dc09406 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:42.518939 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b53267ff-1228-41ef-8f16-14036dc09406 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:42.519365 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b53267ff-1228-41ef-8f16-14036dc09406 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:42.536136 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-b53267ff-1228-41ef-8f16-14036dc09406 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Getting quotas for project 3bcbf5128513465d90455031cb597111. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:57:42.540086 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.quota [None req-b53267ff-1228-41ef-8f16-14036dc09406 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Getting quotas for user 642f135899cc46d982a09e345d254a3c and project 3bcbf5128513465d90455031cb597111. Resources: {'instances', 'ram', 'cores'} {{(pid=101271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:57:42.550656 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b53267ff-1228-41ef-8f16-14036dc09406 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Going to run 1 instances... {{(pid=101271) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 02:57:42.552929 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b53267ff-1228-41ef-8f16-14036dc09406 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ee94749-244e-4e9a-babe-d75d31db807f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 02:57:42.597216 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b53267ff-1228-41ef-8f16-14036dc09406 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.408547 Apr 08 02:57:42.597844 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 473/964] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 02:57:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:57:42.607641 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5460d031-f8d8-4126-8273-867faa2f13f1 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:42.608388 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5460d031-f8d8-4126-8273-867faa2f13f1 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:42.766251 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-5460d031-f8d8-4126-8273-867faa2f13f1 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642f135899cc46d982a09e345d254a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbf5128513465d90455031cb597111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:42.773706 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5460d031-f8d8-4126-8273-867faa2f13f1 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98" status: 200 len: 1214 microversion: 2.1 time: 0.169886 Apr 08 02:57:42.774265 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 492/965] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:42 2022] GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:42.890560 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-0f3726ad-d112-4b18-bdb0-e7f6e0e5444f tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:42.891175 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-0f3726ad-d112-4b18-bdb0-e7f6e0e5444f tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:42.898724 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0f3726ad-d112-4b18-bdb0-e7f6e0e5444f tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:42.899325 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0f3726ad-d112-4b18-bdb0-e7f6e0e5444f tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:42.900192 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0f3726ad-d112-4b18-bdb0-e7f6e0e5444f tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:42.900632 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0f3726ad-d112-4b18-bdb0-e7f6e0e5444f tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:43.090360 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-09c91768-d3bb-490d-bb39-813f88550bde tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:43.091897 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-09c91768-d3bb-490d-bb39-813f88550bde tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:43.100504 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-09c91768-d3bb-490d-bb39-813f88550bde tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:43.100740 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-09c91768-d3bb-490d-bb39-813f88550bde tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:43.101675 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-09c91768-d3bb-490d-bb39-813f88550bde tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:43.102266 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-09c91768-d3bb-490d-bb39-813f88550bde tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:43.104290 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0f3726ad-d112-4b18-bdb0-e7f6e0e5444f tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:43.114032 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-0f3726ad-d112-4b18-bdb0-e7f6e0e5444f tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1757 microversion: 2.1 time: 0.228042 Apr 08 02:57:43.115034 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 474/966] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:42 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1757 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:43.310979 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-09c91768-d3bb-490d-bb39-813f88550bde tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:43.319033 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-09c91768-d3bb-490d-bb39-813f88550bde tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1267 microversion: 2.1 time: 0.232342 Apr 08 02:57:43.319586 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 493/967] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:43 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:57:43.790741 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-0060113f-7d41-45c6-925d-d82fbde8884b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:43.791431 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-0060113f-7d41-45c6-925d-d82fbde8884b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:43.799672 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0060113f-7d41-45c6-925d-d82fbde8884b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:43.800414 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0060113f-7d41-45c6-925d-d82fbde8884b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:43.801194 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0060113f-7d41-45c6-925d-d82fbde8884b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:43.801636 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-0060113f-7d41-45c6-925d-d82fbde8884b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:44.039354 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-0060113f-7d41-45c6-925d-d82fbde8884b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642f135899cc46d982a09e345d254a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbf5128513465d90455031cb597111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:44.048779 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-0060113f-7d41-45c6-925d-d82fbde8884b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98" status: 200 len: 1272 microversion: 2.1 time: 0.261931 Apr 08 02:57:44.049265 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 475/968] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:43 2022] GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98 => generated 1272 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:44.130403 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-43727b85-83ad-447e-82e7-7e235a007008 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:44.131025 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-43727b85-83ad-447e-82e7-7e235a007008 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:44.138854 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-43727b85-83ad-447e-82e7-7e235a007008 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:44.139305 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-43727b85-83ad-447e-82e7-7e235a007008 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:44.140118 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-43727b85-83ad-447e-82e7-7e235a007008 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:44.140555 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-43727b85-83ad-447e-82e7-7e235a007008 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:44.336296 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8a0d6c36-0934-4710-ba27-a6040aa6369a tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:44.337277 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-8a0d6c36-0934-4710-ba27-a6040aa6369a tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:44.345700 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8a0d6c36-0934-4710-ba27-a6040aa6369a tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:44.345861 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-43727b85-83ad-447e-82e7-7e235a007008 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:44.346475 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8a0d6c36-0934-4710-ba27-a6040aa6369a tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:44.347461 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8a0d6c36-0934-4710-ba27-a6040aa6369a tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:44.347891 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8a0d6c36-0934-4710-ba27-a6040aa6369a tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:44.354800 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-43727b85-83ad-447e-82e7-7e235a007008 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1757 microversion: 2.1 time: 0.228077 Apr 08 02:57:44.355456 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 494/969] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:44 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1757 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:44.698275 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-8a0d6c36-0934-4710-ba27-a6040aa6369a tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:44.706469 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8a0d6c36-0934-4710-ba27-a6040aa6369a tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1267 microversion: 2.1 time: 0.374149 Apr 08 02:57:44.707026 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 476/970] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:44 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1267 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:57:45.065470 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-aba0c9bd-cf09-4fab-b3fb-cf120bceb27b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:45.066080 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-aba0c9bd-cf09-4fab-b3fb-cf120bceb27b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:45.073924 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aba0c9bd-cf09-4fab-b3fb-cf120bceb27b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:45.074662 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aba0c9bd-cf09-4fab-b3fb-cf120bceb27b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:45.076157 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aba0c9bd-cf09-4fab-b3fb-cf120bceb27b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:45.076628 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-aba0c9bd-cf09-4fab-b3fb-cf120bceb27b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:45.284072 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-aba0c9bd-cf09-4fab-b3fb-cf120bceb27b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642f135899cc46d982a09e345d254a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbf5128513465d90455031cb597111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:45.292331 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-aba0c9bd-cf09-4fab-b3fb-cf120bceb27b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98" status: 200 len: 1314 microversion: 2.1 time: 0.230526 Apr 08 02:57:45.292893 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 495/971] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:45 2022] GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:45.371855 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e97ef867-a6f2-42c4-9aa7-a98bfa8138a4 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:45.372490 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e97ef867-a6f2-42c4-9aa7-a98bfa8138a4 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:45.379675 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e97ef867-a6f2-42c4-9aa7-a98bfa8138a4 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:45.380096 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e97ef867-a6f2-42c4-9aa7-a98bfa8138a4 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:45.380851 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e97ef867-a6f2-42c4-9aa7-a98bfa8138a4 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:45.381275 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e97ef867-a6f2-42c4-9aa7-a98bfa8138a4 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:45.723644 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-53757727-6203-4a4b-b7d0-e8522252e63c tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:45.724474 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-53757727-6203-4a4b-b7d0-e8522252e63c tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:45.738036 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-53757727-6203-4a4b-b7d0-e8522252e63c tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:45.739639 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-53757727-6203-4a4b-b7d0-e8522252e63c tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:45.740679 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-53757727-6203-4a4b-b7d0-e8522252e63c tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:45.741111 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-53757727-6203-4a4b-b7d0-e8522252e63c tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:45.756841 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e97ef867-a6f2-42c4-9aa7-a98bfa8138a4 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:45.781622 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e97ef867-a6f2-42c4-9aa7-a98bfa8138a4 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1760 microversion: 2.1 time: 0.413377 Apr 08 02:57:45.782206 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 477/972] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:45 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1760 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:45.983962 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-53757727-6203-4a4b-b7d0-e8522252e63c tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:45.992875 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-53757727-6203-4a4b-b7d0-e8522252e63c tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1267 microversion: 2.1 time: 0.272943 Apr 08 02:57:45.994126 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 496/973] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:45 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1267 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:57:46.245292 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-f7c46e5e-1d46-47f9-a927-a50eac1c8a43 req-ed5bb4aa-2df2-4e65-a420-f9640ec25d71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76972826-3a66-4dd6-957f-d448c17bec98", "tag": "3e011a69-ff28-4e48-9715-de9177851145"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:46.253743 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:46.253743 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:57:46.263721 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-f7c46e5e-1d46-47f9-a927-a50eac1c8a43 req-ed5bb4aa-2df2-4e65-a420-f9640ec25d71 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:46.264200 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-f7c46e5e-1d46-47f9-a927-a50eac1c8a43 req-ed5bb4aa-2df2-4e65-a420-f9640ec25d71 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:46.282412 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-f7c46e5e-1d46-47f9-a927-a50eac1c8a43 req-ed5bb4aa-2df2-4e65-a420-f9640ec25d71 service nova] Creating event network-changed:3e011a69-ff28-4e48-9715-de9177851145 for instance 76972826-3a66-4dd6-957f-d448c17bec98 on hv-cinder-83705 Apr 08 02:57:46.287618 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-f7c46e5e-1d46-47f9-a927-a50eac1c8a43 req-ed5bb4aa-2df2-4e65-a420-f9640ec25d71 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045590 Apr 08 02:57:46.288197 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 478/974] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:57:46.311004 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-bdde0e83-3b8b-4b16-a573-ba8b6e4e6bb6 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:46.311790 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-bdde0e83-3b8b-4b16-a573-ba8b6e4e6bb6 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:46.319733 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bdde0e83-3b8b-4b16-a573-ba8b6e4e6bb6 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:46.320220 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bdde0e83-3b8b-4b16-a573-ba8b6e4e6bb6 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:46.321020 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bdde0e83-3b8b-4b16-a573-ba8b6e4e6bb6 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:46.321516 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-bdde0e83-3b8b-4b16-a573-ba8b6e4e6bb6 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:46.527379 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-bdde0e83-3b8b-4b16-a573-ba8b6e4e6bb6 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642f135899cc46d982a09e345d254a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbf5128513465d90455031cb597111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:46.536221 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-bdde0e83-3b8b-4b16-a573-ba8b6e4e6bb6 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98" status: 200 len: 1314 microversion: 2.1 time: 0.230346 Apr 08 02:57:46.536810 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 497/975] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:46 2022] GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:47.010957 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-74c1352e-f142-4971-8607-b773662b5be6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:47.011566 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-74c1352e-f142-4971-8607-b773662b5be6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:47.019204 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-74c1352e-f142-4971-8607-b773662b5be6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:47.019659 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-74c1352e-f142-4971-8607-b773662b5be6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:47.020455 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-74c1352e-f142-4971-8607-b773662b5be6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:47.020899 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-74c1352e-f142-4971-8607-b773662b5be6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:47.394114 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-74c1352e-f142-4971-8607-b773662b5be6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:47.402319 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-74c1352e-f142-4971-8607-b773662b5be6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1267 microversion: 2.1 time: 0.395668 Apr 08 02:57:47.403526 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 479/976] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:47 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1267 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:47.554385 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-dc4363a2-eb81-4ece-bf31-a912ed0b7c83 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:47.554958 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-dc4363a2-eb81-4ece-bf31-a912ed0b7c83 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:47.563211 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-dc4363a2-eb81-4ece-bf31-a912ed0b7c83 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:47.563546 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-dc4363a2-eb81-4ece-bf31-a912ed0b7c83 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:47.564364 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-dc4363a2-eb81-4ece-bf31-a912ed0b7c83 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:47.564807 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-dc4363a2-eb81-4ece-bf31-a912ed0b7c83 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:47.788052 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-dc4363a2-eb81-4ece-bf31-a912ed0b7c83 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642f135899cc46d982a09e345d254a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbf5128513465d90455031cb597111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:47.797421 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-dc4363a2-eb81-4ece-bf31-a912ed0b7c83 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98" status: 200 len: 1314 microversion: 2.1 time: 0.246910 Apr 08 02:57:47.797997 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 498/977] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:47 2022] GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:48.419890 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e7d070d3-607b-4636-b048-9a720c8cd0f5 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:48.420530 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e7d070d3-607b-4636-b048-9a720c8cd0f5 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:48.427848 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e7d070d3-607b-4636-b048-9a720c8cd0f5 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:48.428322 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e7d070d3-607b-4636-b048-9a720c8cd0f5 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:48.429079 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e7d070d3-607b-4636-b048-9a720c8cd0f5 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:48.429516 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e7d070d3-607b-4636-b048-9a720c8cd0f5 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:48.623765 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-e7d070d3-607b-4636-b048-9a720c8cd0f5 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:48.631902 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e7d070d3-607b-4636-b048-9a720c8cd0f5 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1267 microversion: 2.1 time: 0.215948 Apr 08 02:57:48.632483 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 480/978] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:48 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:48.820174 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-19a9c8cc-e984-4b63-b3fc-55850410aa3f tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:48.820907 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-19a9c8cc-e984-4b63-b3fc-55850410aa3f tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:48.828378 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-19a9c8cc-e984-4b63-b3fc-55850410aa3f tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:48.828829 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-19a9c8cc-e984-4b63-b3fc-55850410aa3f tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:48.829625 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-19a9c8cc-e984-4b63-b3fc-55850410aa3f tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:48.830052 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-19a9c8cc-e984-4b63-b3fc-55850410aa3f tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:49.026782 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-19a9c8cc-e984-4b63-b3fc-55850410aa3f tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642f135899cc46d982a09e345d254a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbf5128513465d90455031cb597111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:49.035570 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-19a9c8cc-e984-4b63-b3fc-55850410aa3f tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98" status: 200 len: 1314 microversion: 2.1 time: 0.224345 Apr 08 02:57:49.036151 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 499/979] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:48 2022] GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:49.648957 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d7410dbd-d358-41f2-8b4b-a325f04a5419 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:49.649559 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-d7410dbd-d358-41f2-8b4b-a325f04a5419 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:49.657517 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d7410dbd-d358-41f2-8b4b-a325f04a5419 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:49.657963 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d7410dbd-d358-41f2-8b4b-a325f04a5419 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:49.658718 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d7410dbd-d358-41f2-8b4b-a325f04a5419 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:49.659150 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d7410dbd-d358-41f2-8b4b-a325f04a5419 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:49.855505 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-d7410dbd-d358-41f2-8b4b-a325f04a5419 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:49.864481 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-d7410dbd-d358-41f2-8b4b-a325f04a5419 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1267 microversion: 2.1 time: 0.219001 Apr 08 02:57:49.865042 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 481/980] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:49 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:50.052257 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-562370a5-deaa-4823-b340-097c018d7893 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:50.052863 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-562370a5-deaa-4823-b340-097c018d7893 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:50.060533 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-562370a5-deaa-4823-b340-097c018d7893 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:50.060926 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-562370a5-deaa-4823-b340-097c018d7893 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:50.061686 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-562370a5-deaa-4823-b340-097c018d7893 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:50.062122 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-562370a5-deaa-4823-b340-097c018d7893 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:50.258268 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-562370a5-deaa-4823-b340-097c018d7893 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642f135899cc46d982a09e345d254a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbf5128513465d90455031cb597111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:50.266755 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-562370a5-deaa-4823-b340-097c018d7893 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98" status: 200 len: 1314 microversion: 2.1 time: 0.218184 Apr 08 02:57:50.267324 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 500/981] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:50 2022] GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:50.881890 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b7fcf180-0d94-4962-a6fb-ff4f958f82fc tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:50.882621 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b7fcf180-0d94-4962-a6fb-ff4f958f82fc tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:50.890703 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b7fcf180-0d94-4962-a6fb-ff4f958f82fc tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:50.891157 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b7fcf180-0d94-4962-a6fb-ff4f958f82fc tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:50.891951 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b7fcf180-0d94-4962-a6fb-ff4f958f82fc tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:50.892393 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b7fcf180-0d94-4962-a6fb-ff4f958f82fc tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:51.077973 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-d115c26a-6cf5-4309-b36c-dd2ee3f86385 req-692285ea-25c1-43ba-8b9d-69a86cf1d976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b0931a-d15f-4ff6-bfc7-5490869d6892", "name": "network-vif-plugged", "status": "completed", "tag": "56f98f9e-78b0-44c5-8f41-7a79b4c6433b"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:51.079777 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:51.079777 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:57:51.090610 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-d115c26a-6cf5-4309-b36c-dd2ee3f86385 req-692285ea-25c1-43ba-8b9d-69a86cf1d976 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:51.091149 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-d115c26a-6cf5-4309-b36c-dd2ee3f86385 req-692285ea-25c1-43ba-8b9d-69a86cf1d976 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:51.101159 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b7fcf180-0d94-4962-a6fb-ff4f958f82fc tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:51.107917 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-d115c26a-6cf5-4309-b36c-dd2ee3f86385 req-692285ea-25c1-43ba-8b9d-69a86cf1d976 service nova] Creating event network-vif-plugged:56f98f9e-78b0-44c5-8f41-7a79b4c6433b for instance 00b0931a-d15f-4ff6-bfc7-5490869d6892 on hv-cinder-83705 Apr 08 02:57:51.109655 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b7fcf180-0d94-4962-a6fb-ff4f958f82fc tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1267 microversion: 2.1 time: 0.231641 Apr 08 02:57:51.110413 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 482/982] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:50 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:51.112886 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-d115c26a-6cf5-4309-b36c-dd2ee3f86385 req-692285ea-25c1-43ba-8b9d-69a86cf1d976 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040749 Apr 08 02:57:51.113886 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 501/983] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:57:51.284132 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a937789d-4dbd-4991-9db9-52d4ac75dd56 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:51.284782 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a937789d-4dbd-4991-9db9-52d4ac75dd56 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:51.292229 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a937789d-4dbd-4991-9db9-52d4ac75dd56 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:51.292679 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a937789d-4dbd-4991-9db9-52d4ac75dd56 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:51.294235 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a937789d-4dbd-4991-9db9-52d4ac75dd56 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:51.294731 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a937789d-4dbd-4991-9db9-52d4ac75dd56 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:51.617934 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a937789d-4dbd-4991-9db9-52d4ac75dd56 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642f135899cc46d982a09e345d254a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbf5128513465d90455031cb597111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:51.626741 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a937789d-4dbd-4991-9db9-52d4ac75dd56 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98" status: 200 len: 1314 microversion: 2.1 time: 0.346579 Apr 08 02:57:51.627314 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 483/984] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:51 2022] GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:52.127586 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0dbabe99-f347-4389-b158-20c275044522 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:52.128308 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0dbabe99-f347-4389-b158-20c275044522 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:52.135734 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0dbabe99-f347-4389-b158-20c275044522 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:52.136208 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0dbabe99-f347-4389-b158-20c275044522 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:52.136963 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0dbabe99-f347-4389-b158-20c275044522 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:52.138249 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0dbabe99-f347-4389-b158-20c275044522 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:52.331976 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0dbabe99-f347-4389-b158-20c275044522 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:52.339936 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0dbabe99-f347-4389-b158-20c275044522 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1267 microversion: 2.1 time: 0.216483 Apr 08 02:57:52.340514 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 502/985] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:52 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:52.643570 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4a7bf240-3574-4622-a190-adfee563e64b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:52.644208 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-4a7bf240-3574-4622-a190-adfee563e64b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:52.651336 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4a7bf240-3574-4622-a190-adfee563e64b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:52.651774 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4a7bf240-3574-4622-a190-adfee563e64b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:52.653045 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4a7bf240-3574-4622-a190-adfee563e64b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:52.653894 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4a7bf240-3574-4622-a190-adfee563e64b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:52.857770 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4a7bf240-3574-4622-a190-adfee563e64b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642f135899cc46d982a09e345d254a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbf5128513465d90455031cb597111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:52.865841 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4a7bf240-3574-4622-a190-adfee563e64b tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98" status: 200 len: 1314 microversion: 2.1 time: 0.225915 Apr 08 02:57:52.866400 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 484/986] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:52 2022] GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:53.129330 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-0faf76c1-2a0b-42e9-8f9e-775c8e05c6c7 req-72981260-11d3-45d5-a29b-910858033615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76972826-3a66-4dd6-957f-d448c17bec98", "name": "network-vif-plugged", "status": "completed", "tag": "3e011a69-ff28-4e48-9715-de9177851145"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:53.130850 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:53.130850 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:57:53.139998 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-0faf76c1-2a0b-42e9-8f9e-775c8e05c6c7 req-72981260-11d3-45d5-a29b-910858033615 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:53.140448 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-0faf76c1-2a0b-42e9-8f9e-775c8e05c6c7 req-72981260-11d3-45d5-a29b-910858033615 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:53.156974 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-0faf76c1-2a0b-42e9-8f9e-775c8e05c6c7 req-72981260-11d3-45d5-a29b-910858033615 service nova] Creating event network-vif-plugged:3e011a69-ff28-4e48-9715-de9177851145 for instance 76972826-3a66-4dd6-957f-d448c17bec98 on hv-cinder-83705 Apr 08 02:57:53.161708 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-0faf76c1-2a0b-42e9-8f9e-775c8e05c6c7 req-72981260-11d3-45d5-a29b-910858033615 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035996 Apr 08 02:57:53.162281 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 503/987] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:57:53.356751 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-707d574b-df28-40cf-978d-ba223722b4c9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:53.357358 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-707d574b-df28-40cf-978d-ba223722b4c9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:53.365007 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-707d574b-df28-40cf-978d-ba223722b4c9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:53.365453 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-707d574b-df28-40cf-978d-ba223722b4c9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:53.366246 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-707d574b-df28-40cf-978d-ba223722b4c9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:53.366688 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-707d574b-df28-40cf-978d-ba223722b4c9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:53.630616 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-707d574b-df28-40cf-978d-ba223722b4c9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:53.639951 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-707d574b-df28-40cf-978d-ba223722b4c9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1453 microversion: 2.1 time: 0.286853 Apr 08 02:57:53.640533 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 485/988] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:53 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1453 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:53.656947 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-d07ada66-0f3f-4a30-99fa-3169bec988b1 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:53.657623 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-d07ada66-0f3f-4a30-99fa-3169bec988b1 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:53.665352 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d07ada66-0f3f-4a30-99fa-3169bec988b1 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:53.665798 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d07ada66-0f3f-4a30-99fa-3169bec988b1 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:53.666559 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d07ada66-0f3f-4a30-99fa-3169bec988b1 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:53.666989 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-d07ada66-0f3f-4a30-99fa-3169bec988b1 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:53.881093 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-d07ada66-0f3f-4a30-99fa-3169bec988b1 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:53.885044 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fa9ebd95-59bd-45ec-955a-fe7c5daa6267 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:53.885671 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-fa9ebd95-59bd-45ec-955a-fe7c5daa6267 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:53.889963 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-d07ada66-0f3f-4a30-99fa-3169bec988b1 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1453 microversion: 2.1 time: 0.237264 Apr 08 02:57:53.890539 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 504/989] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:53 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1453 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:53.893686 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fa9ebd95-59bd-45ec-955a-fe7c5daa6267 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:53.894137 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fa9ebd95-59bd-45ec-955a-fe7c5daa6267 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:53.894917 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fa9ebd95-59bd-45ec-955a-fe7c5daa6267 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:53.896636 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fa9ebd95-59bd-45ec-955a-fe7c5daa6267 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:54.101420 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fa9ebd95-59bd-45ec-955a-fe7c5daa6267 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642f135899cc46d982a09e345d254a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbf5128513465d90455031cb597111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:54.115762 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-fa9ebd95-59bd-45ec-955a-fe7c5daa6267 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98" status: 200 len: 1314 microversion: 2.1 time: 0.235604 Apr 08 02:57:54.116636 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 486/990] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:53 2022] GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:57:55.133177 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0338644b-be58-4461-ac36-5dc2f0dd345a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:55.133667 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0338644b-be58-4461-ac36-5dc2f0dd345a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:55.141872 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0338644b-be58-4461-ac36-5dc2f0dd345a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:55.142326 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0338644b-be58-4461-ac36-5dc2f0dd345a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:55.143106 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0338644b-be58-4461-ac36-5dc2f0dd345a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:55.143543 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0338644b-be58-4461-ac36-5dc2f0dd345a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:55.375544 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-0338644b-be58-4461-ac36-5dc2f0dd345a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642f135899cc46d982a09e345d254a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbf5128513465d90455031cb597111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:55.383662 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0338644b-be58-4461-ac36-5dc2f0dd345a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98" status: 200 len: 1464 microversion: 2.1 time: 0.254324 Apr 08 02:57:55.384190 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 505/991] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:55 2022] GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98 => generated 1464 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:55.454585 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e70b4f28-1f22-437c-983a-683c7946ace5 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:55.455229 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e70b4f28-1f22-437c-983a-683c7946ace5 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:55.462575 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e70b4f28-1f22-437c-983a-683c7946ace5 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:55.463027 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e70b4f28-1f22-437c-983a-683c7946ace5 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:55.464010 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e70b4f28-1f22-437c-983a-683c7946ace5 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:55.464450 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e70b4f28-1f22-437c-983a-683c7946ace5 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:55.532098 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e70b4f28-1f22-437c-983a-683c7946ace5 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Going to try to terminate instance {{(pid=101271) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:57:55.655475 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e70b4f28-1f22-437c-983a-683c7946ace5 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "DELETE /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98" status: 204 len: 0 microversion: 2.1 time: 0.204199 Apr 08 02:57:55.656494 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 487/992] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:57:55 2022] DELETE /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:57:55.664202 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-cf5d06fe-55b5-458f-b08a-fe59761897d2 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:55.664813 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-cf5d06fe-55b5-458f-b08a-fe59761897d2 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:55.672895 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cf5d06fe-55b5-458f-b08a-fe59761897d2 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:55.673341 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cf5d06fe-55b5-458f-b08a-fe59761897d2 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:55.674100 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cf5d06fe-55b5-458f-b08a-fe59761897d2 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:55.674533 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-cf5d06fe-55b5-458f-b08a-fe59761897d2 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:56.119726 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-cf5d06fe-55b5-458f-b08a-fe59761897d2 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642f135899cc46d982a09e345d254a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbf5128513465d90455031cb597111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:56.128499 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-cf5d06fe-55b5-458f-b08a-fe59761897d2 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98" status: 200 len: 1470 microversion: 2.1 time: 0.467921 Apr 08 02:57:56.129254 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 506/993] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:55 2022] GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98 => generated 1470 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:56.772155 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-18d56ba6-6019-47ca-883d-e68940eb82ab req-860a6eac-d8aa-4086-885f-8fed2b74f88b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b0931a-d15f-4ff6-bfc7-5490869d6892", "tag": "56f98f9e-78b0-44c5-8f41-7a79b4c6433b"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:56.773679 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:56.773679 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:57:56.781940 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-18d56ba6-6019-47ca-883d-e68940eb82ab req-860a6eac-d8aa-4086-885f-8fed2b74f88b service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:56.782419 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-18d56ba6-6019-47ca-883d-e68940eb82ab req-860a6eac-d8aa-4086-885f-8fed2b74f88b service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:56.798778 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-18d56ba6-6019-47ca-883d-e68940eb82ab req-860a6eac-d8aa-4086-885f-8fed2b74f88b service nova] Creating event network-changed:56f98f9e-78b0-44c5-8f41-7a79b4c6433b for instance 00b0931a-d15f-4ff6-bfc7-5490869d6892 on hv-cinder-83705 Apr 08 02:57:56.803609 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-18d56ba6-6019-47ca-883d-e68940eb82ab req-860a6eac-d8aa-4086-885f-8fed2b74f88b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035538 Apr 08 02:57:56.804416 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 488/994] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:57:57.146352 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ce69b037-36f7-4115-aaa5-fb21f0606881 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:57.146962 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ce69b037-36f7-4115-aaa5-fb21f0606881 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:57.155320 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce69b037-36f7-4115-aaa5-fb21f0606881 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:57.155762 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce69b037-36f7-4115-aaa5-fb21f0606881 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:57.156562 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce69b037-36f7-4115-aaa5-fb21f0606881 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:57.156991 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce69b037-36f7-4115-aaa5-fb21f0606881 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:57.367911 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ce69b037-36f7-4115-aaa5-fb21f0606881 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642f135899cc46d982a09e345d254a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbf5128513465d90455031cb597111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:57.376192 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ce69b037-36f7-4115-aaa5-fb21f0606881 tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98" status: 200 len: 1470 microversion: 2.1 time: 0.233372 Apr 08 02:57:57.376761 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 507/995] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:57 2022] GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98 => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:58.393937 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2e44c3c2-6e2a-43c3-bb24-b02efb82ba0a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:58.394745 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2e44c3c2-6e2a-43c3-bb24-b02efb82ba0a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:58.402787 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2e44c3c2-6e2a-43c3-bb24-b02efb82ba0a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:58.403382 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2e44c3c2-6e2a-43c3-bb24-b02efb82ba0a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:58.404209 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2e44c3c2-6e2a-43c3-bb24-b02efb82ba0a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:58.404648 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2e44c3c2-6e2a-43c3-bb24-b02efb82ba0a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:58.472756 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2e44c3c2-6e2a-43c3-bb24-b02efb82ba0a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:58.473093 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2e44c3c2-6e2a-43c3-bb24-b02efb82ba0a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:58.473539 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.objects.instance [None req-2e44c3c2-6e2a-43c3-bb24-b02efb82ba0a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lazy-loading 'fault' on Instance uuid 76972826-3a66-4dd6-957f-d448c17bec98 {{(pid=101271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:57:58.630282 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2e44c3c2-6e2a-43c3-bb24-b02efb82ba0a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642f135899cc46d982a09e345d254a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbf5128513465d90455031cb597111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:57:58.638482 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2e44c3c2-6e2a-43c3-bb24-b02efb82ba0a tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98" status: 200 len: 1304 microversion: 2.1 time: 0.248847 Apr 08 02:57:58.639034 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 489/996] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:58 2022] GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98 => generated 1304 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:58.817586 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-13417a95-7321-4bd7-a8eb-01d9d790ef30 req-dc8baa5d-2373-4511-89bc-224549b76c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76972826-3a66-4dd6-957f-d448c17bec98", "name": "network-vif-deleted", "tag": "3e011a69-ff28-4e48-9715-de9177851145"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:58.819323 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:58.819323 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:57:58.827696 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-13417a95-7321-4bd7-a8eb-01d9d790ef30 req-dc8baa5d-2373-4511-89bc-224549b76c82 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:58.828173 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-13417a95-7321-4bd7-a8eb-01d9d790ef30 req-dc8baa5d-2373-4511-89bc-224549b76c82 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:58.844597 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-13417a95-7321-4bd7-a8eb-01d9d790ef30 req-dc8baa5d-2373-4511-89bc-224549b76c82 service nova] Creating event network-vif-deleted:3e011a69-ff28-4e48-9715-de9177851145 for instance 76972826-3a66-4dd6-957f-d448c17bec98 on hv-cinder-83705 Apr 08 02:57:58.849238 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-13417a95-7321-4bd7-a8eb-01d9d790ef30 req-dc8baa5d-2373-4511-89bc-224549b76c82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035440 Apr 08 02:57:58.849826 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 508/997] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:57:59.655538 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-87d35665-64ca-4ba5-9bef-c92ba09fed3c tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:59.656179 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-87d35665-64ca-4ba5-9bef-c92ba09fed3c tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] [instance: 76972826-3a66-4dd6-957f-d448c17bec98] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:57:59.663358 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-87d35665-64ca-4ba5-9bef-c92ba09fed3c tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:59.663802 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-87d35665-64ca-4ba5-9bef-c92ba09fed3c tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:59.664595 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-87d35665-64ca-4ba5-9bef-c92ba09fed3c tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:59.665034 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-87d35665-64ca-4ba5-9bef-c92ba09fed3c tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:59.717666 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-87d35665-64ca-4ba5-9bef-c92ba09fed3c tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] HTTP exception thrown: Instance 76972826-3a66-4dd6-957f-d448c17bec98 could not be found. Apr 08 02:57:59.718260 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-87d35665-64ca-4ba5-9bef-c92ba09fed3c tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] Returning 404 to user: Instance 76972826-3a66-4dd6-957f-d448c17bec98 could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:57:59.719079 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-87d35665-64ca-4ba5-9bef-c92ba09fed3c tempest-VolumesNegativeTest-804684601 tempest-VolumesNegativeTest-804684601-project] 10.222.0.23 "GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98" status: 404 len: 111 microversion: 2.1 time: 0.067470 Apr 08 02:57:59.719625 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 490/998] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:59 2022] GET /compute/v2.1/servers/76972826-3a66-4dd6-957f-d448c17bec98 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:58:49.105562 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d9fa6679-801e-426a-940e-b397a2917c18] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 08 02:58:49.110299 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-5e8cc0d0-2483-4044-9c5b-1753d734c69b tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1720633139"}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:58:49.111031 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-5e8cc0d0-2483-4044-9c5b-1753d734c69b tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:58:49.118503 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5e8cc0d0-2483-4044-9c5b-1753d734c69b tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:49.118954 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5e8cc0d0-2483-4044-9c5b-1753d734c69b tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:49.119721 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5e8cc0d0-2483-4044-9c5b-1753d734c69b tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:49.120183 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-5e8cc0d0-2483-4044-9c5b-1753d734c69b tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:49.521996 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.network.security_group_api [None req-5e8cc0d0-2483-4044-9c5b-1753d734c69b tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Removing security group c57ef43a-295b-43de-9373-934279b2ae58 from port c585c168-7e51-4ca1-8f45-2f19dde4b67a Apr 08 02:58:49.985026 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-5e8cc0d0-2483-4044-9c5b-1753d734c69b tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "POST /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c/action" status: 202 len: 0 microversion: 2.1 time: 0.881224 Apr 08 02:58:49.985814 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 509/999] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Apr 8 02:58:49 2022] POST /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c/action => generated 0 bytes in 883 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:58:49.994783 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-cf1ae8e4-1e32-4fa5-8362-85196b0b9178 req-e2b50e34-772a-4e8f-86a3-17c26a203115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeb2b2fc-3410-4860-a03b-cab8c080197c", "tag": "c585c168-7e51-4ca1-8f45-2f19dde4b67a"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:58:49.996473 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:58:49.996473 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:58:50.004744 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e4d5fc08-ecc7-44d0-8530-9a72f3edc802] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 08 02:58:50.008232 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-cf1ae8e4-1e32-4fa5-8362-85196b0b9178 req-e2b50e34-772a-4e8f-86a3-17c26a203115 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:50.008670 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-cf1ae8e4-1e32-4fa5-8362-85196b0b9178 req-e2b50e34-772a-4e8f-86a3-17c26a203115 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:50.036834 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-cf1ae8e4-1e32-4fa5-8362-85196b0b9178 req-e2b50e34-772a-4e8f-86a3-17c26a203115 service nova] Creating event network-changed:c585c168-7e51-4ca1-8f45-2f19dde4b67a for instance aeb2b2fc-3410-4860-a03b-cab8c080197c on hv-cinder-83705 Apr 08 02:58:50.043861 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-cf1ae8e4-1e32-4fa5-8362-85196b0b9178 req-e2b50e34-772a-4e8f-86a3-17c26a203115 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054309 Apr 08 02:58:50.045608 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 491/1000] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:58:51.893269 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1b1c1e5d-fb65-41a6-87d7-ea6565c214fc tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:58:51.893822 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1b1c1e5d-fb65-41a6-87d7-ea6565c214fc tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:58:51.901340 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-21612f53-3052-4484-ad91-44e7b694354e req-45b0cd28-362e-4d36-ae9f-330a118807b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeb2b2fc-3410-4860-a03b-cab8c080197c", "tag": "c585c168-7e51-4ca1-8f45-2f19dde4b67a"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:58:51.902804 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:58:51.902804 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 02:58:51.912544 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1b1c1e5d-fb65-41a6-87d7-ea6565c214fc tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:51.912768 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-21612f53-3052-4484-ad91-44e7b694354e req-45b0cd28-362e-4d36-ae9f-330a118807b5 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:51.913021 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1b1c1e5d-fb65-41a6-87d7-ea6565c214fc tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:51.913155 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-21612f53-3052-4484-ad91-44e7b694354e req-45b0cd28-362e-4d36-ae9f-330a118807b5 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:51.913782 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1b1c1e5d-fb65-41a6-87d7-ea6565c214fc tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:51.914324 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1b1c1e5d-fb65-41a6-87d7-ea6565c214fc tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:51.929478 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-21612f53-3052-4484-ad91-44e7b694354e req-45b0cd28-362e-4d36-ae9f-330a118807b5 service nova] Creating event network-changed:c585c168-7e51-4ca1-8f45-2f19dde4b67a for instance aeb2b2fc-3410-4860-a03b-cab8c080197c on hv-cinder-83705 Apr 08 02:58:51.934346 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-21612f53-3052-4484-ad91-44e7b694354e req-45b0cd28-362e-4d36-ae9f-330a118807b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036959 Apr 08 02:58:51.936002 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 492/1001] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:58:51.977794 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO oslo.messaging._drivers.impl_rabbit [-] [d9fa6679-801e-426a-940e-b397a2917c18] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35962. Apr 08 02:58:52.074196 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.objects.instance [None req-1b1c1e5d-fb65-41a6-87d7-ea6565c214fc tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lazy-loading 'services' on Instance uuid aeb2b2fc-3410-4860-a03b-cab8c080197c {{(pid=101272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:58:52.225002 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1b1c1e5d-fb65-41a6-87d7-ea6565c214fc tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c/os-volume_attachments/7e234d45-4289-4337-a746-eb1e551fb172" status: 202 len: 0 microversion: 2.1 time: 0.336815 Apr 08 02:58:52.225586 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 510/1002] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Apr 8 02:58:51 2022] DELETE /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c/os-volume_attachments/7e234d45-4289-4337-a746-eb1e551fb172 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:58:52.235094 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-caad410b-4fe0-4613-b119-f19d88a1dd7a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:58:52.236331 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-caad410b-4fe0-4613-b119-f19d88a1dd7a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:58:52.242221 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO oslo.messaging._drivers.impl_rabbit [-] [e4d5fc08-ecc7-44d0-8530-9a72f3edc802] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35964. Apr 08 02:58:52.246207 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-caad410b-4fe0-4613-b119-f19d88a1dd7a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:52.246908 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-caad410b-4fe0-4613-b119-f19d88a1dd7a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:52.247771 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-caad410b-4fe0-4613-b119-f19d88a1dd7a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:52.248827 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-caad410b-4fe0-4613-b119-f19d88a1dd7a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:52.322158 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-caad410b-4fe0-4613-b119-f19d88a1dd7a tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091592 Apr 08 02:58:52.322614 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 493/1003] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:58:52 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:58:53.337091 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-dd813580-3a3c-47d7-84e0-56130476bcd0 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:58:53.338174 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-dd813580-3a3c-47d7-84e0-56130476bcd0 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:58:53.346161 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-dd813580-3a3c-47d7-84e0-56130476bcd0 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:53.346608 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-dd813580-3a3c-47d7-84e0-56130476bcd0 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:53.347411 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-dd813580-3a3c-47d7-84e0-56130476bcd0 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:53.347843 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-dd813580-3a3c-47d7-84e0-56130476bcd0 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:53.418377 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-dd813580-3a3c-47d7-84e0-56130476bcd0 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087482 Apr 08 02:58:53.418853 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 511/1004] 10.222.0.23 () {58 vars in 1301 bytes} [Fri Apr 8 02:58:53 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:58:53.430506 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8375d92d-74a4-4d7b-9019-b9e1a47e5bb1 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:58:53.431057 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-8375d92d-74a4-4d7b-9019-b9e1a47e5bb1 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:58:53.441238 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8375d92d-74a4-4d7b-9019-b9e1a47e5bb1 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:53.442036 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8375d92d-74a4-4d7b-9019-b9e1a47e5bb1 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:53.443338 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8375d92d-74a4-4d7b-9019-b9e1a47e5bb1 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:53.444120 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8375d92d-74a4-4d7b-9019-b9e1a47e5bb1 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:53.740497 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-8375d92d-74a4-4d7b-9019-b9e1a47e5bb1 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] HTTP exception thrown: Instance aeb2b2fc-3410-4860-a03b-cab8c080197c is not attached to volume 7e234d45-4289-4337-a746-eb1e551fb172 Apr 08 02:58:53.741102 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8375d92d-74a4-4d7b-9019-b9e1a47e5bb1 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Returning 404 to user: Instance aeb2b2fc-3410-4860-a03b-cab8c080197c is not attached to volume 7e234d45-4289-4337-a746-eb1e551fb172 {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:58:53.741922 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8375d92d-74a4-4d7b-9019-b9e1a47e5bb1 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c/os-volume_attachments/7e234d45-4289-4337-a746-eb1e551fb172" status: 404 len: 154 microversion: 2.1 time: 0.316075 Apr 08 02:58:53.742480 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 494/1005] 10.222.0.23 () {58 vars in 1415 bytes} [Fri Apr 8 02:58:53 2022] DELETE /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c/os-volume_attachments/7e234d45-4289-4337-a746-eb1e551fb172 => generated 154 bytes in 317 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:58:55.001835 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0437b569-9575-4e23-bf61-bcc3ac9c5d00 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:58:55.002329 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0437b569-9575-4e23-bf61-bcc3ac9c5d00 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:58:55.009509 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0437b569-9575-4e23-bf61-bcc3ac9c5d00 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:55.009957 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0437b569-9575-4e23-bf61-bcc3ac9c5d00 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:55.010729 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0437b569-9575-4e23-bf61-bcc3ac9c5d00 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:55.011174 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0437b569-9575-4e23-bf61-bcc3ac9c5d00 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:55.075098 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0437b569-9575-4e23-bf61-bcc3ac9c5d00 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Going to try to terminate instance {{(pid=101272) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 02:58:55.186211 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0437b569-9575-4e23-bf61-bcc3ac9c5d00 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 204 len: 0 microversion: 2.1 time: 0.187010 Apr 08 02:58:55.186952 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 512/1006] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 02:58:54 2022] DELETE /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:58:55.194967 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-c63e953e-4270-4040-b89f-99ddb7f58129 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:58:55.195567 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-c63e953e-4270-4040-b89f-99ddb7f58129 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:58:55.204061 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c63e953e-4270-4040-b89f-99ddb7f58129 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:55.204453 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c63e953e-4270-4040-b89f-99ddb7f58129 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:55.205209 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c63e953e-4270-4040-b89f-99ddb7f58129 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:55.205638 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-c63e953e-4270-4040-b89f-99ddb7f58129 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:55.421203 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-c63e953e-4270-4040-b89f-99ddb7f58129 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:58:55.429414 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-c63e953e-4270-4040-b89f-99ddb7f58129 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1554 microversion: 2.1 time: 0.238134 Apr 08 02:58:55.429967 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 495/1007] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:58:55 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:58:56.447407 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3975824c-45e1-499b-b5bd-7d5d613c1305 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:58:56.448133 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-3975824c-45e1-499b-b5bd-7d5d613c1305 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:58:56.456152 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3975824c-45e1-499b-b5bd-7d5d613c1305 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:56.456608 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3975824c-45e1-499b-b5bd-7d5d613c1305 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:56.457380 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3975824c-45e1-499b-b5bd-7d5d613c1305 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:56.457820 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3975824c-45e1-499b-b5bd-7d5d613c1305 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:56.667311 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-3975824c-45e1-499b-b5bd-7d5d613c1305 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:58:56.675978 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3975824c-45e1-499b-b5bd-7d5d613c1305 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1554 microversion: 2.1 time: 0.232765 Apr 08 02:58:56.676545 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 513/1008] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:58:56 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1554 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:58:57.694158 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-6301ba4d-8f9d-47ab-b9d9-db0abc3d8049 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:58:57.694835 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-6301ba4d-8f9d-47ab-b9d9-db0abc3d8049 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:58:57.702376 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6301ba4d-8f9d-47ab-b9d9-db0abc3d8049 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:57.702721 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6301ba4d-8f9d-47ab-b9d9-db0abc3d8049 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:57.703501 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6301ba4d-8f9d-47ab-b9d9-db0abc3d8049 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:57.703953 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6301ba4d-8f9d-47ab-b9d9-db0abc3d8049 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:57.900719 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-6301ba4d-8f9d-47ab-b9d9-db0abc3d8049 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c39d689d5b4a848bbab29270c58318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db379f877ebf4bda8bcef28d03d0e3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 02:58:57.909729 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-6301ba4d-8f9d-47ab-b9d9-db0abc3d8049 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 200 len: 1554 microversion: 2.1 time: 0.219393 Apr 08 02:58:57.910292 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 496/1009] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:58:57 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 1554 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:58:58.085848 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-cec4d17a-0d60-4c53-9d3c-7e38933827ef req-8fff4966-58fc-4f3c-b96d-7283e3ee8a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb2b2fc-3410-4860-a03b-cab8c080197c", "name": "network-vif-deleted", "tag": "c585c168-7e51-4ca1-8f45-2f19dde4b67a"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:58:58.087514 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:58:58.087514 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 02:58:58.096487 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-cec4d17a-0d60-4c53-9d3c-7e38933827ef req-8fff4966-58fc-4f3c-b96d-7283e3ee8a26 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:58.097165 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-cec4d17a-0d60-4c53-9d3c-7e38933827ef req-8fff4966-58fc-4f3c-b96d-7283e3ee8a26 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:58.114552 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-cec4d17a-0d60-4c53-9d3c-7e38933827ef req-8fff4966-58fc-4f3c-b96d-7283e3ee8a26 service nova] Creating event network-vif-deleted:c585c168-7e51-4ca1-8f45-2f19dde4b67a for instance aeb2b2fc-3410-4860-a03b-cab8c080197c on hv-cinder-83705 Apr 08 02:58:58.119100 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-cec4d17a-0d60-4c53-9d3c-7e38933827ef req-8fff4966-58fc-4f3c-b96d-7283e3ee8a26 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036942 Apr 08 02:58:58.119857 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 514/1010] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 02:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:58:58.926517 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a7baa4b4-74ab-4d22-b9eb-8598413ef9b3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:58:58.927130 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a7baa4b4-74ab-4d22-b9eb-8598413ef9b3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] [instance: aeb2b2fc-3410-4860-a03b-cab8c080197c] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 02:58:58.934626 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a7baa4b4-74ab-4d22-b9eb-8598413ef9b3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:58.935127 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a7baa4b4-74ab-4d22-b9eb-8598413ef9b3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:58.935897 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a7baa4b4-74ab-4d22-b9eb-8598413ef9b3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:58:58.936364 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a7baa4b4-74ab-4d22-b9eb-8598413ef9b3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:58:58.985259 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-a7baa4b4-74ab-4d22-b9eb-8598413ef9b3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] HTTP exception thrown: Instance aeb2b2fc-3410-4860-a03b-cab8c080197c could not be found. Apr 08 02:58:58.985847 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a7baa4b4-74ab-4d22-b9eb-8598413ef9b3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Returning 404 to user: Instance aeb2b2fc-3410-4860-a03b-cab8c080197c could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 02:58:58.986651 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a7baa4b4-74ab-4d22-b9eb-8598413ef9b3 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c" status: 404 len: 111 microversion: 2.1 time: 0.063956 Apr 08 02:58:58.987173 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 497/1011] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 02:58:58 2022] GET /compute/v2.1/servers/aeb2b2fc-3410-4860-a03b-cab8c080197c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:58:58.996802 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-aec1f645-36b9-4df0-a76b-56546ece9547 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] Calling method '.version_select at 0x7fbc38530e50>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:58:59.018074 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-aec1f645-36b9-4df0-a76b-56546ece9547 tempest-TestMinimumBasicScenario-65639965 tempest-TestMinimumBasicScenario-65639965-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-45975164" status: 202 len: 0 microversion: 2.1 time: 0.026239 Apr 08 02:58:59.018633 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 515/1012] 10.222.0.23 () {58 vars in 1265 bytes} [Fri Apr 8 02:58:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-45975164 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:59:16.779779 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 02:59:16.780374 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: Fri Apr 8 02:59:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 03:00:11.065392 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-49434742-494d-4f6e-aa70-25d55d5213c8 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:11.066092 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-49434742-494d-4f6e-aa70-25d55d5213c8 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:11.073265 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-49434742-494d-4f6e-aa70-25d55d5213c8 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:11.073709 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-49434742-494d-4f6e-aa70-25d55d5213c8 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:11.074460 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-49434742-494d-4f6e-aa70-25d55d5213c8 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:11.075156 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-49434742-494d-4f6e-aa70-25d55d5213c8 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:11.137028 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-49434742-494d-4f6e-aa70-25d55d5213c8 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Going to try to terminate instance {{(pid=101271) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 03:00:11.249765 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-49434742-494d-4f6e-aa70-25d55d5213c8 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "DELETE /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 204 len: 0 microversion: 2.1 time: 0.187766 Apr 08 03:00:11.251442 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 498/1013] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 03:00:11 2022] DELETE /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 03:00:11.259889 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ececa650-774a-4a2f-9d67-126fba2c5ef6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:11.260639 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ececa650-774a-4a2f-9d67-126fba2c5ef6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:11.268553 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ececa650-774a-4a2f-9d67-126fba2c5ef6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:11.268997 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ececa650-774a-4a2f-9d67-126fba2c5ef6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:11.269751 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ececa650-774a-4a2f-9d67-126fba2c5ef6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:11.270182 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ececa650-774a-4a2f-9d67-126fba2c5ef6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:11.470721 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ececa650-774a-4a2f-9d67-126fba2c5ef6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:11.479089 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ececa650-774a-4a2f-9d67-126fba2c5ef6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1577 microversion: 2.1 time: 0.223536 Apr 08 03:00:11.479659 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 516/1014] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:11 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1577 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:12.498278 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a03885bc-1020-420a-a282-e670e9b5a0aa tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:12.498995 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a03885bc-1020-420a-a282-e670e9b5a0aa tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:12.506772 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a03885bc-1020-420a-a282-e670e9b5a0aa tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:12.507230 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a03885bc-1020-420a-a282-e670e9b5a0aa tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:12.508031 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a03885bc-1020-420a-a282-e670e9b5a0aa tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:12.508469 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a03885bc-1020-420a-a282-e670e9b5a0aa tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:12.704913 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a03885bc-1020-420a-a282-e670e9b5a0aa tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:12.713062 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a03885bc-1020-420a-a282-e670e9b5a0aa tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1577 microversion: 2.1 time: 0.219878 Apr 08 03:00:12.713623 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 499/1015] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:12 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1577 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:13.730577 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9e18e65f-ae03-4c7f-bc1e-b578508af92a tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:13.732358 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9e18e65f-ae03-4c7f-bc1e-b578508af92a tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:13.740519 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9e18e65f-ae03-4c7f-bc1e-b578508af92a tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:13.740968 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9e18e65f-ae03-4c7f-bc1e-b578508af92a tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:13.741736 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9e18e65f-ae03-4c7f-bc1e-b578508af92a tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:13.742353 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9e18e65f-ae03-4c7f-bc1e-b578508af92a tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:14.095275 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9e18e65f-ae03-4c7f-bc1e-b578508af92a tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:14.107012 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9e18e65f-ae03-4c7f-bc1e-b578508af92a tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1577 microversion: 2.1 time: 0.379967 Apr 08 03:00:14.116951 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 517/1016] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:13 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1577 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:14.641313 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-c302407f-0896-4e5c-b095-5a75aff11042 req-97c23761-99bd-472f-8962-568bf6cd626d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b0931a-d15f-4ff6-bfc7-5490869d6892", "name": "network-vif-deleted", "tag": "56f98f9e-78b0-44c5-8f41-7a79b4c6433b"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:00:14.642938 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:00:14.642938 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 03:00:14.657326 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-c302407f-0896-4e5c-b095-5a75aff11042 req-97c23761-99bd-472f-8962-568bf6cd626d service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:14.657767 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-c302407f-0896-4e5c-b095-5a75aff11042 req-97c23761-99bd-472f-8962-568bf6cd626d service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:14.675367 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-c302407f-0896-4e5c-b095-5a75aff11042 req-97c23761-99bd-472f-8962-568bf6cd626d service nova] Creating event network-vif-deleted:56f98f9e-78b0-44c5-8f41-7a79b4c6433b for instance 00b0931a-d15f-4ff6-bfc7-5490869d6892 on hv-cinder-83705 Apr 08 03:00:14.680699 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-c302407f-0896-4e5c-b095-5a75aff11042 req-97c23761-99bd-472f-8962-568bf6cd626d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043175 Apr 08 03:00:14.681575 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 500/1017] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 03:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:00:15.125541 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-f143ea64-8257-47a8-8e25-c95d693b4849 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:15.130898 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-f143ea64-8257-47a8-8e25-c95d693b4849 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:15.138811 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f143ea64-8257-47a8-8e25-c95d693b4849 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:15.139287 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f143ea64-8257-47a8-8e25-c95d693b4849 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:15.140815 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f143ea64-8257-47a8-8e25-c95d693b4849 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:15.141277 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f143ea64-8257-47a8-8e25-c95d693b4849 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:15.213314 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f143ea64-8257-47a8-8e25-c95d693b4849 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:15.213766 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-f143ea64-8257-47a8-8e25-c95d693b4849 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:15.214237 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.objects.instance [None req-f143ea64-8257-47a8-8e25-c95d693b4849 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lazy-loading 'fault' on Instance uuid 00b0931a-d15f-4ff6-bfc7-5490869d6892 {{(pid=101272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 03:00:15.285687 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-f143ea64-8257-47a8-8e25-c95d693b4849 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:15.293735 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-f143ea64-8257-47a8-8e25-c95d693b4849 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 200 len: 1231 microversion: 2.1 time: 0.173813 Apr 08 03:00:15.294481 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 518/1018] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:15 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 1231 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:16.312451 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-9e26d76f-75ae-4bd0-a7ba-ad57a7e013a6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:16.313157 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-9e26d76f-75ae-4bd0-a7ba-ad57a7e013a6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:16.320791 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9e26d76f-75ae-4bd0-a7ba-ad57a7e013a6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:16.321247 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9e26d76f-75ae-4bd0-a7ba-ad57a7e013a6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:16.322160 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9e26d76f-75ae-4bd0-a7ba-ad57a7e013a6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:16.322603 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-9e26d76f-75ae-4bd0-a7ba-ad57a7e013a6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:16.374074 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-9e26d76f-75ae-4bd0-a7ba-ad57a7e013a6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] HTTP exception thrown: Instance 00b0931a-d15f-4ff6-bfc7-5490869d6892 could not be found. Apr 08 03:00:16.374675 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-9e26d76f-75ae-4bd0-a7ba-ad57a7e013a6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Returning 404 to user: Instance 00b0931a-d15f-4ff6-bfc7-5490869d6892 could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 03:00:16.375518 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-9e26d76f-75ae-4bd0-a7ba-ad57a7e013a6 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 404 len: 111 microversion: 2.1 time: 0.068213 Apr 08 03:00:16.376202 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 501/1019] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:16 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 03:00:16.479311 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1786490258", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1326577827", "security_groups": [{"name": "tempest-secgroup-smoke-1441768386"}], "block_device_mapping_v2": [{"uuid": "99463c61-ca3c-4507-bfd2-b4bb1ef0df48", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "21a17f5c-b124-484f-a29f-b582b1b5f383"}]}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:00:16.627856 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.network.neutron [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] validate_networks() for [('21a17f5c-b124-484f-a29f-b582b1b5f383', None, None, None)] {{(pid=101272) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 03:00:17.144486 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Flavor limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 03:00:17.144932 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Image limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 03:00:17.145497 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Flavor pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 03:00:17.145907 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Image pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 03:00:17.146318 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 03:00:17.154593 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:17.155036 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:17.155855 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:17.156313 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:17.173325 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Getting quotas for project c0b956e0c3a74df8890d564dadb5ad70. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 03:00:17.177205 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Getting quotas for user 8df441c38c604f1487efba726a41d411 and project c0b956e0c3a74df8890d564dadb5ad70. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 03:00:17.267072 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Going to run 1 instances... {{(pid=101272) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 03:00:17.269220 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='99463c61-ca3c-4507-bfd2-b4bb1ef0df48',volume_size=None,volume_type=None)] {{(pid=101272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 03:00:17.552497 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: ERROR oslo.messaging._drivers.impl_rabbit [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [7ee94c9a-7ae0-40ff-b591-1962ebd6a3e4] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 08 03:00:18.564293 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO oslo.messaging._drivers.impl_rabbit [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [7ee94c9a-7ae0-40ff-b591-1962ebd6a3e4] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36130. Apr 08 03:00:18.571542 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-599d60bb-b80a-41ab-9c9b-58fbdbc11379 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.095907 Apr 08 03:00:18.572232 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 519/1020] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 03:00:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 03:00:18.583744 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fee1270c-6d0d-41b1-9219-be5304862eff tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:18.585268 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-fee1270c-6d0d-41b1-9219-be5304862eff tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:18.654459 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fee1270c-6d0d-41b1-9219-be5304862eff tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:18.661690 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-fee1270c-6d0d-41b1-9219-be5304862eff tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1095 microversion: 2.1 time: 0.082566 Apr 08 03:00:18.662238 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 502/1021] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:18 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:19.678404 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-a3b2d0fc-41d5-4450-828e-98c41d21bbf9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:19.679019 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-a3b2d0fc-41d5-4450-828e-98c41d21bbf9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:19.748395 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a3b2d0fc-41d5-4450-828e-98c41d21bbf9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:19.755866 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-a3b2d0fc-41d5-4450-828e-98c41d21bbf9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1095 microversion: 2.1 time: 0.081107 Apr 08 03:00:19.756409 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 520/1022] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:19 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:20.777748 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-769d390e-0295-4224-a9f4-97cd7e6e2ed4 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:20.778520 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-769d390e-0295-4224-a9f4-97cd7e6e2ed4 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:20.859259 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-769d390e-0295-4224-a9f4-97cd7e6e2ed4 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:20.866625 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-769d390e-0295-4224-a9f4-97cd7e6e2ed4 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1095 microversion: 2.1 time: 0.095424 Apr 08 03:00:20.867176 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 503/1023] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:20 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1095 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:21.883816 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-47a569f3-f2ff-44c8-ae1a-20bd1d0870bd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:21.884460 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-47a569f3-f2ff-44c8-ae1a-20bd1d0870bd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:21.953281 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-47a569f3-f2ff-44c8-ae1a-20bd1d0870bd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:21.960763 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-47a569f3-f2ff-44c8-ae1a-20bd1d0870bd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1095 microversion: 2.1 time: 0.080642 Apr 08 03:00:21.961327 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 521/1024] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:21 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:22.977627 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-27f2ee23-7bac-4733-8f1a-7b146a75b5cb tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:22.978232 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-27f2ee23-7bac-4733-8f1a-7b146a75b5cb tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:22.986013 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-27f2ee23-7bac-4733-8f1a-7b146a75b5cb tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:22.986453 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-27f2ee23-7bac-4733-8f1a-7b146a75b5cb tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:22.987207 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-27f2ee23-7bac-4733-8f1a-7b146a75b5cb tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:22.987643 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-27f2ee23-7bac-4733-8f1a-7b146a75b5cb tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:23.098353 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-27f2ee23-7bac-4733-8f1a-7b146a75b5cb tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:23.106900 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-27f2ee23-7bac-4733-8f1a-7b146a75b5cb tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1145 microversion: 2.1 time: 0.133142 Apr 08 03:00:23.107445 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 504/1025] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:22 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1145 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:24.123878 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-52930b53-7ee7-44d8-9c7d-7f75ca3b6506 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:24.124514 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-52930b53-7ee7-44d8-9c7d-7f75ca3b6506 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:24.131695 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-52930b53-7ee7-44d8-9c7d-7f75ca3b6506 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:24.132176 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-52930b53-7ee7-44d8-9c7d-7f75ca3b6506 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:24.132949 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-52930b53-7ee7-44d8-9c7d-7f75ca3b6506 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:24.133385 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-52930b53-7ee7-44d8-9c7d-7f75ca3b6506 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:24.251574 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-52930b53-7ee7-44d8-9c7d-7f75ca3b6506 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:24.259737 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-52930b53-7ee7-44d8-9c7d-7f75ca3b6506 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1211 microversion: 2.1 time: 0.140110 Apr 08 03:00:24.260587 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 522/1026] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:24 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1211 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:25.277550 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-1f4279b7-63ac-4594-beb3-54727feca5d9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:25.278181 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-1f4279b7-63ac-4594-beb3-54727feca5d9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:25.285412 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1f4279b7-63ac-4594-beb3-54727feca5d9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:25.285866 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1f4279b7-63ac-4594-beb3-54727feca5d9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:25.286636 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1f4279b7-63ac-4594-beb3-54727feca5d9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:25.287101 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-1f4279b7-63ac-4594-beb3-54727feca5d9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:25.491304 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-1f4279b7-63ac-4594-beb3-54727feca5d9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:25.500300 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-1f4279b7-63ac-4594-beb3-54727feca5d9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1267 microversion: 2.1 time: 0.226469 Apr 08 03:00:25.501435 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 505/1027] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:25 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:25.813296 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-be9bcb26-b3ae-4668-b2d8-e3fa72f283e5 req-90469ddb-2e16-447e-8eef-875f9416af51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e67546e2-cbb7-431b-a962-56f9667d39f3", "tag": "f013d251-1676-438c-8a5e-51ad655e31cd"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:00:25.815504 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:00:25.815504 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 03:00:25.825089 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-be9bcb26-b3ae-4668-b2d8-e3fa72f283e5 req-90469ddb-2e16-447e-8eef-875f9416af51 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:25.825987 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-be9bcb26-b3ae-4668-b2d8-e3fa72f283e5 req-90469ddb-2e16-447e-8eef-875f9416af51 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:25.843645 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-be9bcb26-b3ae-4668-b2d8-e3fa72f283e5 req-90469ddb-2e16-447e-8eef-875f9416af51 service nova] Creating event network-changed:f013d251-1676-438c-8a5e-51ad655e31cd for instance e67546e2-cbb7-431b-a962-56f9667d39f3 on hv-cinder-83705 Apr 08 03:00:25.848452 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-be9bcb26-b3ae-4668-b2d8-e3fa72f283e5 req-90469ddb-2e16-447e-8eef-875f9416af51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039481 Apr 08 03:00:25.849383 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 523/1028] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 03:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:00:26.520283 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fbf1874b-6608-4076-8209-41c023f05673 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:26.521155 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-fbf1874b-6608-4076-8209-41c023f05673 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:26.536119 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fbf1874b-6608-4076-8209-41c023f05673 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:26.536571 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fbf1874b-6608-4076-8209-41c023f05673 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:26.537418 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fbf1874b-6608-4076-8209-41c023f05673 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:26.538487 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fbf1874b-6608-4076-8209-41c023f05673 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:26.742761 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fbf1874b-6608-4076-8209-41c023f05673 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:26.751713 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-fbf1874b-6608-4076-8209-41c023f05673 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1267 microversion: 2.1 time: 0.236761 Apr 08 03:00:26.752231 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 506/1029] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:26 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 03:00:27.768775 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-9d2452d8-b047-42f5-b435-4f42151fa0b1 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:27.769478 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-9d2452d8-b047-42f5-b435-4f42151fa0b1 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:27.776977 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9d2452d8-b047-42f5-b435-4f42151fa0b1 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:27.777432 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9d2452d8-b047-42f5-b435-4f42151fa0b1 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:27.778208 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9d2452d8-b047-42f5-b435-4f42151fa0b1 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:27.778647 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-9d2452d8-b047-42f5-b435-4f42151fa0b1 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:27.990394 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-9d2452d8-b047-42f5-b435-4f42151fa0b1 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:27.999064 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-9d2452d8-b047-42f5-b435-4f42151fa0b1 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1267 microversion: 2.1 time: 0.234493 Apr 08 03:00:27.999632 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 524/1030] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:27 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:29.016469 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-8317e777-b806-4f10-99de-7ca8be5d4f6e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:29.017154 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-8317e777-b806-4f10-99de-7ca8be5d4f6e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:29.024404 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8317e777-b806-4f10-99de-7ca8be5d4f6e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:29.024856 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8317e777-b806-4f10-99de-7ca8be5d4f6e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:29.025652 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8317e777-b806-4f10-99de-7ca8be5d4f6e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:29.026089 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-8317e777-b806-4f10-99de-7ca8be5d4f6e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:29.245232 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-8317e777-b806-4f10-99de-7ca8be5d4f6e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:29.253994 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-8317e777-b806-4f10-99de-7ca8be5d4f6e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1267 microversion: 2.1 time: 0.241383 Apr 08 03:00:29.254552 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 507/1031] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:29 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:30.271235 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e9b06b18-d6d6-40c0-b38c-9ff50e53d956 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:30.271891 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e9b06b18-d6d6-40c0-b38c-9ff50e53d956 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:30.279553 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e9b06b18-d6d6-40c0-b38c-9ff50e53d956 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:30.280026 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e9b06b18-d6d6-40c0-b38c-9ff50e53d956 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:30.280785 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e9b06b18-d6d6-40c0-b38c-9ff50e53d956 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:30.281215 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e9b06b18-d6d6-40c0-b38c-9ff50e53d956 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:30.476323 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e9b06b18-d6d6-40c0-b38c-9ff50e53d956 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:30.484777 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e9b06b18-d6d6-40c0-b38c-9ff50e53d956 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1267 microversion: 2.1 time: 0.217232 Apr 08 03:00:30.485426 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 525/1032] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:30 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:31.501621 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-bfbcfb37-0c45-46a5-9677-21a05c575591 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:31.502156 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-bfbcfb37-0c45-46a5-9677-21a05c575591 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:31.509532 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-bfbcfb37-0c45-46a5-9677-21a05c575591 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:31.509975 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-bfbcfb37-0c45-46a5-9677-21a05c575591 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:31.510734 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-bfbcfb37-0c45-46a5-9677-21a05c575591 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:31.511163 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-bfbcfb37-0c45-46a5-9677-21a05c575591 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:31.705302 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-bfbcfb37-0c45-46a5-9677-21a05c575591 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:31.713348 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-bfbcfb37-0c45-46a5-9677-21a05c575591 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1267 microversion: 2.1 time: 0.215602 Apr 08 03:00:31.713906 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 508/1033] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:31 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:32.730294 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-77505226-2ced-4d44-bcb8-0746985647b7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:32.730893 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-77505226-2ced-4d44-bcb8-0746985647b7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:32.738095 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-77505226-2ced-4d44-bcb8-0746985647b7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:32.738538 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-77505226-2ced-4d44-bcb8-0746985647b7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:32.739354 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-77505226-2ced-4d44-bcb8-0746985647b7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:32.739783 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-77505226-2ced-4d44-bcb8-0746985647b7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:32.936990 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-77505226-2ced-4d44-bcb8-0746985647b7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:32.945150 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-77505226-2ced-4d44-bcb8-0746985647b7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1267 microversion: 2.1 time: 0.218585 Apr 08 03:00:32.945711 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 526/1034] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:32 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:33.962106 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5a9e8eea-9a9d-4b12-968c-9d9a4c87eb7e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:33.962744 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-5a9e8eea-9a9d-4b12-968c-9d9a4c87eb7e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:33.970057 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5a9e8eea-9a9d-4b12-968c-9d9a4c87eb7e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:33.970506 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5a9e8eea-9a9d-4b12-968c-9d9a4c87eb7e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:33.971269 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5a9e8eea-9a9d-4b12-968c-9d9a4c87eb7e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:33.971707 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5a9e8eea-9a9d-4b12-968c-9d9a4c87eb7e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:34.175583 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5a9e8eea-9a9d-4b12-968c-9d9a4c87eb7e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:34.184489 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-5a9e8eea-9a9d-4b12-968c-9d9a4c87eb7e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1267 microversion: 2.1 time: 0.226079 Apr 08 03:00:34.185054 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 509/1035] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:33 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:35.201822 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c78751f8-db31-45fc-96b6-895ce35b03a7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:35.202435 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c78751f8-db31-45fc-96b6-895ce35b03a7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:35.209720 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c78751f8-db31-45fc-96b6-895ce35b03a7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:35.210180 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c78751f8-db31-45fc-96b6-895ce35b03a7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:35.210951 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c78751f8-db31-45fc-96b6-895ce35b03a7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:35.211397 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c78751f8-db31-45fc-96b6-895ce35b03a7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:35.404561 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c78751f8-db31-45fc-96b6-895ce35b03a7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:35.414495 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c78751f8-db31-45fc-96b6-895ce35b03a7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1267 microversion: 2.1 time: 0.216815 Apr 08 03:00:35.415116 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 527/1036] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:35 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:35.600876 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-1b1dd976-aac8-41e6-bfeb-e03305ed990a req-79099128-e37b-4c16-90e9-1dc34d06c3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67546e2-cbb7-431b-a962-56f9667d39f3", "name": "network-vif-plugged", "status": "completed", "tag": "f013d251-1676-438c-8a5e-51ad655e31cd"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:00:35.602482 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:00:35.602482 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 03:00:35.611447 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-1b1dd976-aac8-41e6-bfeb-e03305ed990a req-79099128-e37b-4c16-90e9-1dc34d06c3f4 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:35.611831 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-1b1dd976-aac8-41e6-bfeb-e03305ed990a req-79099128-e37b-4c16-90e9-1dc34d06c3f4 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:35.627963 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-1b1dd976-aac8-41e6-bfeb-e03305ed990a req-79099128-e37b-4c16-90e9-1dc34d06c3f4 service nova] Creating event network-vif-plugged:f013d251-1676-438c-8a5e-51ad655e31cd for instance e67546e2-cbb7-431b-a962-56f9667d39f3 on hv-cinder-83705 Apr 08 03:00:35.632704 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-1b1dd976-aac8-41e6-bfeb-e03305ed990a req-79099128-e37b-4c16-90e9-1dc34d06c3f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035431 Apr 08 03:00:35.633275 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 510/1037] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 03:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:00:36.431251 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-80e5755f-313f-459e-b6ff-f67b3fa01416 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:36.431852 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-80e5755f-313f-459e-b6ff-f67b3fa01416 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:36.440047 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-80e5755f-313f-459e-b6ff-f67b3fa01416 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:36.440468 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-80e5755f-313f-459e-b6ff-f67b3fa01416 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:36.441231 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-80e5755f-313f-459e-b6ff-f67b3fa01416 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:36.441661 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-80e5755f-313f-459e-b6ff-f67b3fa01416 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:36.638859 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-80e5755f-313f-459e-b6ff-f67b3fa01416 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:36.646907 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-80e5755f-313f-459e-b6ff-f67b3fa01416 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1267 microversion: 2.1 time: 0.219350 Apr 08 03:00:36.647459 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 528/1038] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:36 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:37.664004 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-7d6741fd-30d1-454c-9b69-02108bf723d9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:37.664699 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-7d6741fd-30d1-454c-9b69-02108bf723d9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:37.672557 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7d6741fd-30d1-454c-9b69-02108bf723d9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:37.673001 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7d6741fd-30d1-454c-9b69-02108bf723d9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:37.673759 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7d6741fd-30d1-454c-9b69-02108bf723d9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:37.674189 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7d6741fd-30d1-454c-9b69-02108bf723d9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:37.873797 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-7d6741fd-30d1-454c-9b69-02108bf723d9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:37.881323 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-7d6741fd-30d1-454c-9b69-02108bf723d9 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1453 microversion: 2.1 time: 0.221466 Apr 08 03:00:37.881878 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 511/1039] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:37 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1453 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:37.897645 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-ce8737f7-a1e4-421e-9b47-d4cff067e667 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:00:37.898256 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-ce8737f7-a1e4-421e-9b47-d4cff067e667 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:00:37.906531 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce8737f7-a1e4-421e-9b47-d4cff067e667 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:37.906979 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce8737f7-a1e4-421e-9b47-d4cff067e667 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:37.907754 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce8737f7-a1e4-421e-9b47-d4cff067e667 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:37.908209 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-ce8737f7-a1e4-421e-9b47-d4cff067e667 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:38.098178 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-ce8737f7-a1e4-421e-9b47-d4cff067e667 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:00:38.106505 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-ce8737f7-a1e4-421e-9b47-d4cff067e667 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1453 microversion: 2.1 time: 0.212526 Apr 08 03:00:38.107064 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 529/1040] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:00:37 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1453 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:00:40.505264 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-0f99006a-8288-43b7-aaae-5f9885ce8d6e req-f8847327-f1b9-4ea0-999a-a4e8c013c882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e67546e2-cbb7-431b-a962-56f9667d39f3", "tag": "f013d251-1676-438c-8a5e-51ad655e31cd"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:00:40.507068 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:00:40.507068 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 03:00:40.515500 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-0f99006a-8288-43b7-aaae-5f9885ce8d6e req-f8847327-f1b9-4ea0-999a-a4e8c013c882 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:00:40.516005 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-0f99006a-8288-43b7-aaae-5f9885ce8d6e req-f8847327-f1b9-4ea0-999a-a4e8c013c882 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:00:40.532095 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-0f99006a-8288-43b7-aaae-5f9885ce8d6e req-f8847327-f1b9-4ea0-999a-a4e8c013c882 service nova] Creating event network-changed:f013d251-1676-438c-8a5e-51ad655e31cd for instance e67546e2-cbb7-431b-a962-56f9667d39f3 on hv-cinder-83705 Apr 08 03:00:40.536847 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-0f99006a-8288-43b7-aaae-5f9885ce8d6e req-f8847327-f1b9-4ea0-999a-a4e8c013c882 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035223 Apr 08 03:00:40.537438 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 512/1041] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 03:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:01:01.189744 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 03:01:01.190462 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: Fri Apr 8 03:01:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 03:02:34.446898 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-1c5cf6b1-ddeb-47eb-894e-90dee0cf9075 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1534737429", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1326577827", "security_groups": [{"name": "tempest-secgroup-smoke-1441768386"}], "block_device_mapping_v2": [{"uuid": "ce2f9414-96ba-4124-a9d6-959a1564c25d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "21a17f5c-b124-484f-a29f-b582b1b5f383"}]}} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:02:34.593529 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.network.neutron [None req-1c5cf6b1-ddeb-47eb-894e-90dee0cf9075 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] validate_networks() for [('21a17f5c-b124-484f-a29f-b582b1b5f383', None, None, None)] {{(pid=101272) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Apr 08 03:02:35.247096 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-1c5cf6b1-ddeb-47eb-894e-90dee0cf9075 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Flavor limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 03:02:35.247523 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-1c5cf6b1-ddeb-47eb-894e-90dee0cf9075 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Image limits 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 03:02:35.248100 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-1c5cf6b1-ddeb-47eb-894e-90dee0cf9075 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Flavor pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 03:02:35.248516 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-1c5cf6b1-ddeb-47eb-894e-90dee0cf9075 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Image pref 0:0:0 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 03:02:35.248927 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.virt.hardware [None req-1c5cf6b1-ddeb-47eb-894e-90dee0cf9075 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 03:02:35.257171 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1c5cf6b1-ddeb-47eb-894e-90dee0cf9075 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:35.257630 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1c5cf6b1-ddeb-47eb-894e-90dee0cf9075 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:35.258414 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1c5cf6b1-ddeb-47eb-894e-90dee0cf9075 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:35.258862 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-1c5cf6b1-ddeb-47eb-894e-90dee0cf9075 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:35.280105 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-1c5cf6b1-ddeb-47eb-894e-90dee0cf9075 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Getting quotas for project c0b956e0c3a74df8890d564dadb5ad70. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 03:02:35.284100 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.quota [None req-1c5cf6b1-ddeb-47eb-894e-90dee0cf9075 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Getting quotas for user 8df441c38c604f1487efba726a41d411 and project c0b956e0c3a74df8890d564dadb5ad70. Resources: {'instances', 'ram', 'cores'} {{(pid=101272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 03:02:35.374634 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1c5cf6b1-ddeb-47eb-894e-90dee0cf9075 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Going to run 1 instances... {{(pid=101272) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 03:02:35.376869 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-1c5cf6b1-ddeb-47eb-894e-90dee0cf9075 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce2f9414-96ba-4124-a9d6-959a1564c25d',volume_size=None,volume_type=None)] {{(pid=101272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 08 03:02:35.546136 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-1c5cf6b1-ddeb-47eb-894e-90dee0cf9075 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.102802 Apr 08 03:02:35.547225 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 530/1042] 10.222.0.23 () {60 vars in 1146 bytes} [Fri Apr 8 03:02:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 03:02:35.554609 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e4d5fc08-ecc7-44d0-8530-9a72f3edc802] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 08 03:02:35.558361 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-cc03521b-b132-4689-a2fe-8aad9ce6fc00 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:35.559303 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-cc03521b-b132-4689-a2fe-8aad9ce6fc00 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:02:35.634393 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-cc03521b-b132-4689-a2fe-8aad9ce6fc00 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:02:35.644513 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-cc03521b-b132-4689-a2fe-8aad9ce6fc00 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1095 microversion: 2.1 time: 0.091231 Apr 08 03:02:35.645092 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 513/1043] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:35 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1095 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:36.661886 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c81916c6-3333-4599-a530-36ff395d56dd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:36.662405 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c81916c6-3333-4599-a530-36ff395d56dd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:02:36.670428 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c81916c6-3333-4599-a530-36ff395d56dd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:36.670877 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c81916c6-3333-4599-a530-36ff395d56dd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:36.671634 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c81916c6-3333-4599-a530-36ff395d56dd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:36.672101 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c81916c6-3333-4599-a530-36ff395d56dd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:36.787666 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 03:02:36.788111 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: Fri Apr 8 03:02:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 03:02:36.789130 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-c81916c6-3333-4599-a530-36ff395d56dd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:02:36.798037 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c81916c6-3333-4599-a530-36ff395d56dd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1193 microversion: 2.1 time: 0.139863 Apr 08 03:02:36.798613 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 531/1044] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:36 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1193 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:37.820279 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-2a6daa0e-20cd-4cba-8c40-b077a36c2a7b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:37.820907 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-2a6daa0e-20cd-4cba-8c40-b077a36c2a7b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:02:37.833184 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2a6daa0e-20cd-4cba-8c40-b077a36c2a7b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:37.833636 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2a6daa0e-20cd-4cba-8c40-b077a36c2a7b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:37.834422 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2a6daa0e-20cd-4cba-8c40-b077a36c2a7b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:37.834853 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-2a6daa0e-20cd-4cba-8c40-b077a36c2a7b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:37.868633 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO oslo.messaging._drivers.impl_rabbit [-] [e4d5fc08-ecc7-44d0-8530-9a72f3edc802] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36302. Apr 08 03:02:38.053607 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-2a6daa0e-20cd-4cba-8c40-b077a36c2a7b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:02:38.062072 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-2a6daa0e-20cd-4cba-8c40-b077a36c2a7b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1267 microversion: 2.1 time: 0.250679 Apr 08 03:02:38.062717 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 514/1045] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:37 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:38.903173 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-de18025c-fb97-421e-9ff9-fcab4db2ba52 req-dbfb72c6-2abb-4e4c-8a15-87c169959d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef5a80ce-2d3f-479d-addf-d7e1464475d1", "tag": "4adb38c5-882c-496a-85c8-6d97105c5b68"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:02:38.904765 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:02:38.904765 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 03:02:38.913419 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-de18025c-fb97-421e-9ff9-fcab4db2ba52 req-dbfb72c6-2abb-4e4c-8a15-87c169959d06 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:38.913859 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-de18025c-fb97-421e-9ff9-fcab4db2ba52 req-dbfb72c6-2abb-4e4c-8a15-87c169959d06 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:38.934489 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-de18025c-fb97-421e-9ff9-fcab4db2ba52 req-dbfb72c6-2abb-4e4c-8a15-87c169959d06 service nova] Creating event network-changed:4adb38c5-882c-496a-85c8-6d97105c5b68 for instance ef5a80ce-2d3f-479d-addf-d7e1464475d1 on hv-cinder-83705 Apr 08 03:02:38.939344 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-de18025c-fb97-421e-9ff9-fcab4db2ba52 req-dbfb72c6-2abb-4e4c-8a15-87c169959d06 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178177 Apr 08 03:02:38.939949 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 532/1046] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 03:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:02:39.078649 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-f229b5f4-9081-4aee-849b-07435d6728bd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:39.079383 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-f229b5f4-9081-4aee-849b-07435d6728bd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:02:39.086763 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f229b5f4-9081-4aee-849b-07435d6728bd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:39.087294 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f229b5f4-9081-4aee-849b-07435d6728bd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:39.088185 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f229b5f4-9081-4aee-849b-07435d6728bd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:39.088851 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-f229b5f4-9081-4aee-849b-07435d6728bd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:39.292860 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-f229b5f4-9081-4aee-849b-07435d6728bd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:02:39.301172 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-f229b5f4-9081-4aee-849b-07435d6728bd tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1267 microversion: 2.1 time: 0.226252 Apr 08 03:02:39.301741 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 515/1047] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:39 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:40.319950 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-fc781d9f-7e63-40e8-be00-4dd1cf347100 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:40.320596 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-fc781d9f-7e63-40e8-be00-4dd1cf347100 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:02:40.329252 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fc781d9f-7e63-40e8-be00-4dd1cf347100 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:40.329702 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fc781d9f-7e63-40e8-be00-4dd1cf347100 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:40.330462 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fc781d9f-7e63-40e8-be00-4dd1cf347100 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:40.330894 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-fc781d9f-7e63-40e8-be00-4dd1cf347100 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:40.553846 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-fc781d9f-7e63-40e8-be00-4dd1cf347100 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:02:40.562687 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-fc781d9f-7e63-40e8-be00-4dd1cf347100 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1267 microversion: 2.1 time: 0.247010 Apr 08 03:02:40.563254 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 533/1048] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:40 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:41.579418 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-6849e50d-ddf8-4edb-860a-6c0bdf089296 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:41.579992 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-6849e50d-ddf8-4edb-860a-6c0bdf089296 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:02:41.587369 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6849e50d-ddf8-4edb-860a-6c0bdf089296 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:41.587816 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6849e50d-ddf8-4edb-860a-6c0bdf089296 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:41.588764 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6849e50d-ddf8-4edb-860a-6c0bdf089296 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:41.589212 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-6849e50d-ddf8-4edb-860a-6c0bdf089296 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:41.791843 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-6849e50d-ddf8-4edb-860a-6c0bdf089296 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:02:41.799863 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-6849e50d-ddf8-4edb-860a-6c0bdf089296 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1267 microversion: 2.1 time: 0.224182 Apr 08 03:02:41.800472 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 516/1049] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:41 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:42.817587 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-8b428490-ec77-4a5d-8841-ce2da40179c5 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:42.818129 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-8b428490-ec77-4a5d-8841-ce2da40179c5 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:02:42.825827 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8b428490-ec77-4a5d-8841-ce2da40179c5 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:42.826272 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8b428490-ec77-4a5d-8841-ce2da40179c5 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:42.827030 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8b428490-ec77-4a5d-8841-ce2da40179c5 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:42.827459 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8b428490-ec77-4a5d-8841-ce2da40179c5 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:43.018525 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-8b428490-ec77-4a5d-8841-ce2da40179c5 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:02:43.027355 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-8b428490-ec77-4a5d-8841-ce2da40179c5 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1267 microversion: 2.1 time: 0.213600 Apr 08 03:02:43.027912 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 534/1050] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:42 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:44.043332 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-49876353-b37a-436f-8694-73580e206ec7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:44.043946 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-49876353-b37a-436f-8694-73580e206ec7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:02:44.051102 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-49876353-b37a-436f-8694-73580e206ec7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:44.051540 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-49876353-b37a-436f-8694-73580e206ec7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:44.052319 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-49876353-b37a-436f-8694-73580e206ec7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:44.052749 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-49876353-b37a-436f-8694-73580e206ec7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:44.245797 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-49876353-b37a-436f-8694-73580e206ec7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:02:44.253829 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-49876353-b37a-436f-8694-73580e206ec7 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1267 microversion: 2.1 time: 0.214139 Apr 08 03:02:44.254382 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 517/1051] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:44 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:45.270952 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-8840cb50-00e2-45cd-a326-29f272c223aa tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:45.271572 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-8840cb50-00e2-45cd-a326-29f272c223aa tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:02:45.279590 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8840cb50-00e2-45cd-a326-29f272c223aa tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:45.280070 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8840cb50-00e2-45cd-a326-29f272c223aa tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:45.280848 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8840cb50-00e2-45cd-a326-29f272c223aa tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:45.281287 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-8840cb50-00e2-45cd-a326-29f272c223aa tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:45.661501 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-8840cb50-00e2-45cd-a326-29f272c223aa tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:02:45.670733 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-8840cb50-00e2-45cd-a326-29f272c223aa tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1267 microversion: 2.1 time: 0.403475 Apr 08 03:02:45.671513 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 535/1052] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:45 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1267 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:46.686607 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-cc2d4245-f8f9-4c89-af36-198b59834e47 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:46.687244 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-cc2d4245-f8f9-4c89-af36-198b59834e47 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:02:46.694437 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cc2d4245-f8f9-4c89-af36-198b59834e47 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:46.694880 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cc2d4245-f8f9-4c89-af36-198b59834e47 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:46.695631 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cc2d4245-f8f9-4c89-af36-198b59834e47 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:46.696095 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-cc2d4245-f8f9-4c89-af36-198b59834e47 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:46.893256 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-cc2d4245-f8f9-4c89-af36-198b59834e47 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:02:46.902614 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-cc2d4245-f8f9-4c89-af36-198b59834e47 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1267 microversion: 2.1 time: 0.219911 Apr 08 03:02:46.903157 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 518/1053] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:46 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:47.920760 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-da21c3fb-9575-418a-b8b3-9421921b0a08 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:47.921504 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-da21c3fb-9575-418a-b8b3-9421921b0a08 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:02:47.929484 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-da21c3fb-9575-418a-b8b3-9421921b0a08 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:47.930961 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-da21c3fb-9575-418a-b8b3-9421921b0a08 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:47.930961 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-da21c3fb-9575-418a-b8b3-9421921b0a08 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:47.931298 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-da21c3fb-9575-418a-b8b3-9421921b0a08 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:48.125561 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-da21c3fb-9575-418a-b8b3-9421921b0a08 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:02:48.133879 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-da21c3fb-9575-418a-b8b3-9421921b0a08 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1267 microversion: 2.1 time: 0.218446 Apr 08 03:02:48.134442 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 536/1054] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:47 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:49.150902 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-5483c72a-a8e7-416a-9329-f8acc39b85bf tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:49.151524 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-5483c72a-a8e7-416a-9329-f8acc39b85bf tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:02:49.159141 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5483c72a-a8e7-416a-9329-f8acc39b85bf tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:49.159631 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5483c72a-a8e7-416a-9329-f8acc39b85bf tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:49.160425 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5483c72a-a8e7-416a-9329-f8acc39b85bf tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:49.160889 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-5483c72a-a8e7-416a-9329-f8acc39b85bf tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:49.356797 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-5483c72a-a8e7-416a-9329-f8acc39b85bf tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:02:49.364953 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-5483c72a-a8e7-416a-9329-f8acc39b85bf tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1267 microversion: 2.1 time: 0.218314 Apr 08 03:02:49.365512 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 519/1055] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:49 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:50.320264 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-1a55c10f-3632-4ed7-9d67-3fb5665c8a2c req-d7bc32bf-06d7-40e1-bbf1-1a68e72c59ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef5a80ce-2d3f-479d-addf-d7e1464475d1", "name": "network-vif-plugged", "status": "completed", "tag": "4adb38c5-882c-496a-85c8-6d97105c5b68"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:02:50.321778 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:02:50.321778 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 03:02:50.330873 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-1a55c10f-3632-4ed7-9d67-3fb5665c8a2c req-d7bc32bf-06d7-40e1-bbf1-1a68e72c59ae service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:50.331435 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-1a55c10f-3632-4ed7-9d67-3fb5665c8a2c req-d7bc32bf-06d7-40e1-bbf1-1a68e72c59ae service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:50.347914 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-1a55c10f-3632-4ed7-9d67-3fb5665c8a2c req-d7bc32bf-06d7-40e1-bbf1-1a68e72c59ae service nova] Creating event network-vif-plugged:4adb38c5-882c-496a-85c8-6d97105c5b68 for instance ef5a80ce-2d3f-479d-addf-d7e1464475d1 on hv-cinder-83705 Apr 08 03:02:50.352592 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-1a55c10f-3632-4ed7-9d67-3fb5665c8a2c req-d7bc32bf-06d7-40e1-bbf1-1a68e72c59ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088369 Apr 08 03:02:50.353188 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 537/1056] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 03:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:02:50.382035 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-7f3e4e24-e0a3-4176-a275-885a8e90dd6f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:50.382682 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-7f3e4e24-e0a3-4176-a275-885a8e90dd6f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:02:50.390862 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7f3e4e24-e0a3-4176-a275-885a8e90dd6f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:50.391298 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7f3e4e24-e0a3-4176-a275-885a8e90dd6f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:50.392100 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7f3e4e24-e0a3-4176-a275-885a8e90dd6f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:50.392556 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7f3e4e24-e0a3-4176-a275-885a8e90dd6f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:50.593099 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-7f3e4e24-e0a3-4176-a275-885a8e90dd6f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:02:50.601210 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-7f3e4e24-e0a3-4176-a275-885a8e90dd6f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1267 microversion: 2.1 time: 0.223135 Apr 08 03:02:50.601772 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 520/1057] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:50 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:51.618516 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-3645fba8-b98f-4c46-80c9-35fdea84e3ed tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:51.619971 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-3645fba8-b98f-4c46-80c9-35fdea84e3ed tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:02:51.627355 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3645fba8-b98f-4c46-80c9-35fdea84e3ed tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:51.627804 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3645fba8-b98f-4c46-80c9-35fdea84e3ed tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:51.628586 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3645fba8-b98f-4c46-80c9-35fdea84e3ed tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:51.629016 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-3645fba8-b98f-4c46-80c9-35fdea84e3ed tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:51.822091 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-3645fba8-b98f-4c46-80c9-35fdea84e3ed tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:02:51.830241 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-3645fba8-b98f-4c46-80c9-35fdea84e3ed tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1267 microversion: 2.1 time: 0.215936 Apr 08 03:02:51.830800 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 538/1058] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:51 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:52.847022 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a87f839e-07d5-4dfd-88d5-1d90cd42f038 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:52.847636 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-a87f839e-07d5-4dfd-88d5-1d90cd42f038 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:02:52.856058 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a87f839e-07d5-4dfd-88d5-1d90cd42f038 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:52.856563 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a87f839e-07d5-4dfd-88d5-1d90cd42f038 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:52.857457 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a87f839e-07d5-4dfd-88d5-1d90cd42f038 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:52.857949 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-a87f839e-07d5-4dfd-88d5-1d90cd42f038 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:53.057314 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-a87f839e-07d5-4dfd-88d5-1d90cd42f038 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:02:53.065640 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a87f839e-07d5-4dfd-88d5-1d90cd42f038 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1454 microversion: 2.1 time: 0.222289 Apr 08 03:02:53.066198 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 521/1059] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:52 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1454 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:53.079985 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d9fa6679-801e-426a-940e-b397a2917c18] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 08 03:02:53.083187 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-17a1721d-7397-480c-8a5c-a3b82362456c tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:53.083945 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-17a1721d-7397-480c-8a5c-a3b82362456c tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:02:53.091116 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-17a1721d-7397-480c-8a5c-a3b82362456c tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:53.091561 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-17a1721d-7397-480c-8a5c-a3b82362456c tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:53.092357 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-17a1721d-7397-480c-8a5c-a3b82362456c tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:53.092789 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-17a1721d-7397-480c-8a5c-a3b82362456c tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:53.528964 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-17a1721d-7397-480c-8a5c-a3b82362456c tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:02:53.537040 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-17a1721d-7397-480c-8a5c-a3b82362456c tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1454 microversion: 2.1 time: 0.458541 Apr 08 03:02:53.537597 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 539/1060] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:53 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1454 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:55.854889 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-e962d531-0105-43db-a1b8-efb937201280 req-7cee44d0-8a26-4049-a49c-40e1e8434f51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef5a80ce-2d3f-479d-addf-d7e1464475d1", "tag": "4adb38c5-882c-496a-85c8-6d97105c5b68"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:02:55.856996 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:02:55.856996 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 03:02:55.865644 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-e962d531-0105-43db-a1b8-efb937201280 req-7cee44d0-8a26-4049-a49c-40e1e8434f51 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:55.866091 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-e962d531-0105-43db-a1b8-efb937201280 req-7cee44d0-8a26-4049-a49c-40e1e8434f51 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:55.882538 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-e962d531-0105-43db-a1b8-efb937201280 req-7cee44d0-8a26-4049-a49c-40e1e8434f51 service nova] Creating event network-changed:4adb38c5-882c-496a-85c8-6d97105c5b68 for instance ef5a80ce-2d3f-479d-addf-d7e1464475d1 on hv-cinder-83705 Apr 08 03:02:55.887595 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-e962d531-0105-43db-a1b8-efb937201280 req-7cee44d0-8a26-4049-a49c-40e1e8434f51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036942 Apr 08 03:02:55.888199 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 522/1061] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 03:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:04:04.592821 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 03:04:04.593732 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: Fri Apr 8 03:04:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 03:04:21.198279 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 03:04:21.199462 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: Fri Apr 8 03:04:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 03:04:46.425416 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-32d1af18-cfee-46f7-9940-ac32d1d46a4b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:46.425978 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-32d1af18-cfee-46f7-9940-ac32d1d46a4b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:04:46.441091 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-32d1af18-cfee-46f7-9940-ac32d1d46a4b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:46.441324 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-32d1af18-cfee-46f7-9940-ac32d1d46a4b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:46.442111 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-32d1af18-cfee-46f7-9940-ac32d1d46a4b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:46.442755 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-32d1af18-cfee-46f7-9940-ac32d1d46a4b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:46.502981 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO oslo.messaging._drivers.impl_rabbit [-] [d9fa6679-801e-426a-940e-b397a2917c18] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36386. Apr 08 03:04:46.511526 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-32d1af18-cfee-46f7-9940-ac32d1d46a4b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Going to try to terminate instance {{(pid=101272) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 03:04:46.514474 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [req-bd3f67f5-75cf-48e8-bbbb-5af647148d27 req-84a56387-930c-4a10-8c24-8831f9f53696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef5a80ce-2d3f-479d-addf-d7e1464475d1", "tag": "4adb38c5-882c-496a-85c8-6d97105c5b68"}]} {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:04:46.516123 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:04:46.516123 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: warnings.warn(msg) Apr 08 03:04:46.524488 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-bd3f67f5-75cf-48e8-bbbb-5af647148d27 req-84a56387-930c-4a10-8c24-8831f9f53696 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:46.525209 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [req-bd3f67f5-75cf-48e8-bbbb-5af647148d27 req-84a56387-930c-4a10-8c24-8831f9f53696 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:46.541388 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.compute.server_external_events [req-bd3f67f5-75cf-48e8-bbbb-5af647148d27 req-84a56387-930c-4a10-8c24-8831f9f53696 service nova] Creating event network-changed:4adb38c5-882c-496a-85c8-6d97105c5b68 for instance ef5a80ce-2d3f-479d-addf-d7e1464475d1 on hv-cinder-83705 Apr 08 03:04:46.547546 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [req-bd3f67f5-75cf-48e8-bbbb-5af647148d27 req-84a56387-930c-4a10-8c24-8831f9f53696 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113401 Apr 08 03:04:46.548361 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 523/1062] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 03:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:04:46.631762 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-32d1af18-cfee-46f7-9940-ac32d1d46a4b tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 204 len: 0 microversion: 2.1 time: 0.209745 Apr 08 03:04:46.633397 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 540/1063] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 03:04:46 2022] DELETE /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 03:04:46.643653 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-08d54882-333b-400e-8904-660093bcd4ad tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:46.644467 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-08d54882-333b-400e-8904-660093bcd4ad tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:04:46.652604 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-08d54882-333b-400e-8904-660093bcd4ad tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:46.653175 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-08d54882-333b-400e-8904-660093bcd4ad tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:46.654248 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-08d54882-333b-400e-8904-660093bcd4ad tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:46.654936 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-08d54882-333b-400e-8904-660093bcd4ad tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:47.038765 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-08d54882-333b-400e-8904-660093bcd4ad tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:04:47.049317 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-08d54882-333b-400e-8904-660093bcd4ad tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1579 microversion: 2.1 time: 0.409894 Apr 08 03:04:47.049964 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 524/1064] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:46 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1579 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:04:48.068390 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-a85659d0-df89-4ad6-9c7c-258e8c765b02 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:48.069113 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-a85659d0-df89-4ad6-9c7c-258e8c765b02 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:04:48.077796 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a85659d0-df89-4ad6-9c7c-258e8c765b02 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:48.078346 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a85659d0-df89-4ad6-9c7c-258e8c765b02 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:48.079107 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a85659d0-df89-4ad6-9c7c-258e8c765b02 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:48.079539 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-a85659d0-df89-4ad6-9c7c-258e8c765b02 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:48.326391 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-a85659d0-df89-4ad6-9c7c-258e8c765b02 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:04:48.334455 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-a85659d0-df89-4ad6-9c7c-258e8c765b02 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1460 microversion: 2.1 time: 0.270271 Apr 08 03:04:48.335039 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 541/1065] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:48 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1460 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:04:49.352165 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-4e6b846e-7aa1-4150-89aa-f40576b808f8 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:49.352900 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-4e6b846e-7aa1-4150-89aa-f40576b808f8 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:04:49.361330 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4e6b846e-7aa1-4150-89aa-f40576b808f8 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:49.361781 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4e6b846e-7aa1-4150-89aa-f40576b808f8 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:49.362569 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4e6b846e-7aa1-4150-89aa-f40576b808f8 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:49.363007 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-4e6b846e-7aa1-4150-89aa-f40576b808f8 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:49.483554 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-4e6b846e-7aa1-4150-89aa-f40576b808f8 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:04:49.491823 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-4e6b846e-7aa1-4150-89aa-f40576b808f8 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1392 microversion: 2.1 time: 0.143440 Apr 08 03:04:49.492650 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 525/1066] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:49 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1392 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:04:49.540809 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-6cedb8ab-1127-41d4-90e7-4f41e4bc0b90 req-dfd62d0a-2db8-49d9-854c-d9236d7adfea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef5a80ce-2d3f-479d-addf-d7e1464475d1", "name": "network-vif-deleted", "tag": "4adb38c5-882c-496a-85c8-6d97105c5b68"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:04:49.542419 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:04:49.542419 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 03:04:49.550750 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-6cedb8ab-1127-41d4-90e7-4f41e4bc0b90 req-dfd62d0a-2db8-49d9-854c-d9236d7adfea service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:49.551195 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-6cedb8ab-1127-41d4-90e7-4f41e4bc0b90 req-dfd62d0a-2db8-49d9-854c-d9236d7adfea service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:49.567380 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-6cedb8ab-1127-41d4-90e7-4f41e4bc0b90 req-dfd62d0a-2db8-49d9-854c-d9236d7adfea service nova] Creating event network-vif-deleted:4adb38c5-882c-496a-85c8-6d97105c5b68 for instance ef5a80ce-2d3f-479d-addf-d7e1464475d1 on hv-cinder-83705 Apr 08 03:04:49.572095 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-6cedb8ab-1127-41d4-90e7-4f41e4bc0b90 req-dfd62d0a-2db8-49d9-854c-d9236d7adfea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034985 Apr 08 03:04:49.572849 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 542/1067] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 03:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:04:50.509480 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-7fa7fbfb-2d42-4fd1-8ab2-e320d7ce1bd2 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:50.510179 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-7fa7fbfb-2d42-4fd1-8ab2-e320d7ce1bd2 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:04:50.517562 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7fa7fbfb-2d42-4fd1-8ab2-e320d7ce1bd2 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:50.518014 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7fa7fbfb-2d42-4fd1-8ab2-e320d7ce1bd2 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:50.518789 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7fa7fbfb-2d42-4fd1-8ab2-e320d7ce1bd2 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:50.519227 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7fa7fbfb-2d42-4fd1-8ab2-e320d7ce1bd2 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:50.591587 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7fa7fbfb-2d42-4fd1-8ab2-e320d7ce1bd2 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:50.592071 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-7fa7fbfb-2d42-4fd1-8ab2-e320d7ce1bd2 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:50.592530 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.objects.instance [None req-7fa7fbfb-2d42-4fd1-8ab2-e320d7ce1bd2 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lazy-loading 'fault' on Instance uuid ef5a80ce-2d3f-479d-addf-d7e1464475d1 {{(pid=101271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 03:04:50.650543 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-7fa7fbfb-2d42-4fd1-8ab2-e320d7ce1bd2 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:04:50.658900 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-7fa7fbfb-2d42-4fd1-8ab2-e320d7ce1bd2 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 200 len: 1185 microversion: 2.1 time: 0.153120 Apr 08 03:04:50.659398 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 526/1068] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:50 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 1185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:04:51.676439 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c5c6b820-7313-400b-bb50-0cf30a797301 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:51.677072 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-c5c6b820-7313-400b-bb50-0cf30a797301 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: ef5a80ce-2d3f-479d-addf-d7e1464475d1] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:04:51.685542 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c5c6b820-7313-400b-bb50-0cf30a797301 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:51.685996 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c5c6b820-7313-400b-bb50-0cf30a797301 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:51.686754 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c5c6b820-7313-400b-bb50-0cf30a797301 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:51.687191 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-c5c6b820-7313-400b-bb50-0cf30a797301 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:51.741838 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-c5c6b820-7313-400b-bb50-0cf30a797301 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] HTTP exception thrown: Instance ef5a80ce-2d3f-479d-addf-d7e1464475d1 could not be found. Apr 08 03:04:51.742476 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-c5c6b820-7313-400b-bb50-0cf30a797301 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Returning 404 to user: Instance ef5a80ce-2d3f-479d-addf-d7e1464475d1 could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 03:04:51.743306 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-c5c6b820-7313-400b-bb50-0cf30a797301 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1" status: 404 len: 111 microversion: 2.1 time: 0.071112 Apr 08 03:04:51.743856 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 543/1069] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:51 2022] GET /compute/v2.1/servers/ef5a80ce-2d3f-479d-addf-d7e1464475d1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 03:04:55.602435 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-d00eaaa6-0c29-4709-aa8c-1e243034df90 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:55.602975 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-d00eaaa6-0c29-4709-aa8c-1e243034df90 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:04:55.605693 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-d2e24010-2f4b-4aa2-8ac8-92a058b17c5d req-beb2c896-4e1a-4f1c-a6c3-bc4e7c7d2559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e67546e2-cbb7-431b-a962-56f9667d39f3", "tag": "f013d251-1676-438c-8a5e-51ad655e31cd"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:04:55.607454 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:04:55.607454 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 03:04:55.611192 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d00eaaa6-0c29-4709-aa8c-1e243034df90 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:55.611640 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d00eaaa6-0c29-4709-aa8c-1e243034df90 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:55.612473 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d00eaaa6-0c29-4709-aa8c-1e243034df90 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:55.612914 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-d00eaaa6-0c29-4709-aa8c-1e243034df90 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:55.616233 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-d2e24010-2f4b-4aa2-8ac8-92a058b17c5d req-beb2c896-4e1a-4f1c-a6c3-bc4e7c7d2559 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:55.616857 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-d2e24010-2f4b-4aa2-8ac8-92a058b17c5d req-beb2c896-4e1a-4f1c-a6c3-bc4e7c7d2559 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:55.633509 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-d2e24010-2f4b-4aa2-8ac8-92a058b17c5d req-beb2c896-4e1a-4f1c-a6c3-bc4e7c7d2559 service nova] Creating event network-changed:f013d251-1676-438c-8a5e-51ad655e31cd for instance e67546e2-cbb7-431b-a962-56f9667d39f3 on hv-cinder-83705 Apr 08 03:04:55.639011 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-d2e24010-2f4b-4aa2-8ac8-92a058b17c5d req-beb2c896-4e1a-4f1c-a6c3-bc4e7c7d2559 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038616 Apr 08 03:04:55.639835 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 544/1070] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 03:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:04:55.674767 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-d00eaaa6-0c29-4709-aa8c-1e243034df90 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Going to try to terminate instance {{(pid=101271) delete /opt/stack/nova/nova/compute/api.py:2562}} Apr 08 03:04:55.813576 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-d00eaaa6-0c29-4709-aa8c-1e243034df90 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 204 len: 0 microversion: 2.1 time: 0.215032 Apr 08 03:04:55.814706 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 527/1071] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 03:04:55 2022] DELETE /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 03:04:55.822922 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-e640b5fb-e983-4a4e-96b0-2f0a1fc8ce76 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:55.824241 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-e640b5fb-e983-4a4e-96b0-2f0a1fc8ce76 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:04:55.831624 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e640b5fb-e983-4a4e-96b0-2f0a1fc8ce76 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:55.832113 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e640b5fb-e983-4a4e-96b0-2f0a1fc8ce76 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:55.832881 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e640b5fb-e983-4a4e-96b0-2f0a1fc8ce76 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:55.833313 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-e640b5fb-e983-4a4e-96b0-2f0a1fc8ce76 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:56.216678 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.policy [None req-e640b5fb-e983-4a4e-96b0-2f0a1fc8ce76 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101272) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:04:56.225251 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-e640b5fb-e983-4a4e-96b0-2f0a1fc8ce76 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1577 microversion: 2.1 time: 0.406296 Apr 08 03:04:56.226379 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 545/1072] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:55 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1577 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:04:57.243539 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-fb3baf5b-6d94-43ef-b845-6bd163d68c1f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:57.244179 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-fb3baf5b-6d94-43ef-b845-6bd163d68c1f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:04:57.251333 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb3baf5b-6d94-43ef-b845-6bd163d68c1f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:57.251781 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb3baf5b-6d94-43ef-b845-6bd163d68c1f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:57.252582 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb3baf5b-6d94-43ef-b845-6bd163d68c1f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:57.253020 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-fb3baf5b-6d94-43ef-b845-6bd163d68c1f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:57.458528 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-fb3baf5b-6d94-43ef-b845-6bd163d68c1f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:04:57.467494 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-fb3baf5b-6d94-43ef-b845-6bd163d68c1f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1459 microversion: 2.1 time: 0.228165 Apr 08 03:04:57.468091 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 528/1073] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:57 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1459 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:04:58.459415 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [req-1e04a507-cf34-4e51-a148-6aaae91cce16 req-3939c32f-5e79-4e94-a0a2-e55a50167749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67546e2-cbb7-431b-a962-56f9667d39f3", "name": "network-vif-deleted", "tag": "f013d251-1676-438c-8a5e-51ad655e31cd"}]} {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:04:58.461138 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:04:58.461138 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: warnings.warn(msg) Apr 08 03:04:58.470784 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-1e04a507-cf34-4e51-a148-6aaae91cce16 req-3939c32f-5e79-4e94-a0a2-e55a50167749 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:58.471308 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [req-1e04a507-cf34-4e51-a148-6aaae91cce16 req-3939c32f-5e79-4e94-a0a2-e55a50167749 service nova] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:58.487805 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-b6e92951-877e-4f1c-947c-9dd712657918 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:58.488468 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-b6e92951-877e-4f1c-947c-9dd712657918 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:04:58.488628 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.compute.server_external_events [req-1e04a507-cf34-4e51-a148-6aaae91cce16 req-3939c32f-5e79-4e94-a0a2-e55a50167749 service nova] Creating event network-vif-deleted:f013d251-1676-438c-8a5e-51ad655e31cd for instance e67546e2-cbb7-431b-a962-56f9667d39f3 on hv-cinder-83705 Apr 08 03:04:58.493560 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [req-1e04a507-cf34-4e51-a148-6aaae91cce16 req-3939c32f-5e79-4e94-a0a2-e55a50167749 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037882 Apr 08 03:04:58.494256 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 546/1074] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Apr 8 03:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:04:58.497779 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b6e92951-877e-4f1c-947c-9dd712657918 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:58.498251 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b6e92951-877e-4f1c-947c-9dd712657918 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:58.499044 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b6e92951-877e-4f1c-947c-9dd712657918 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:58.499658 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-b6e92951-877e-4f1c-947c-9dd712657918 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:58.613460 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.policy [None req-b6e92951-877e-4f1c-947c-9dd712657918 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df441c38c604f1487efba726a41d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b956e0c3a74df8890d564dadb5ad70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101271) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 03:04:58.622385 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-b6e92951-877e-4f1c-947c-9dd712657918 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 200 len: 1226 microversion: 2.1 time: 0.138340 Apr 08 03:04:58.622993 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 529/1075] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:58 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 1226 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:04:59.639310 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0b3c62d6-f8a6-4614-90a1-037437d8cb4f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:59.640036 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-0b3c62d6-f8a6-4614-90a1-037437d8cb4f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: e67546e2-cbb7-431b-a962-56f9667d39f3] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:04:59.648141 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0b3c62d6-f8a6-4614-90a1-037437d8cb4f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:59.648593 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0b3c62d6-f8a6-4614-90a1-037437d8cb4f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:59.649370 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0b3c62d6-f8a6-4614-90a1-037437d8cb4f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:59.649804 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-0b3c62d6-f8a6-4614-90a1-037437d8cb4f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:59.704367 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-0b3c62d6-f8a6-4614-90a1-037437d8cb4f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] HTTP exception thrown: Instance e67546e2-cbb7-431b-a962-56f9667d39f3 could not be found. Apr 08 03:04:59.704966 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-0b3c62d6-f8a6-4614-90a1-037437d8cb4f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Returning 404 to user: Instance e67546e2-cbb7-431b-a962-56f9667d39f3 could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 03:04:59.705783 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-0b3c62d6-f8a6-4614-90a1-037437d8cb4f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3" status: 404 len: 111 microversion: 2.1 time: 0.070826 Apr 08 03:04:59.706330 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 547/1076] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:59 2022] GET /compute/v2.1/servers/e67546e2-cbb7-431b-a962-56f9667d39f3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 03:05:00.462483 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e219b374-5765-479e-a306-b4061cb96729 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:05:00.463071 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.compute.api [None req-e219b374-5765-479e-a306-b4061cb96729 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101271) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:05:00.471065 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e219b374-5765-479e-a306-b4061cb96729 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:05:00.471583 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e219b374-5765-479e-a306-b4061cb96729 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:05:00.472380 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e219b374-5765-479e-a306-b4061cb96729 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:05:00.472838 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG oslo_concurrency.lockutils [None req-e219b374-5765-479e-a306-b4061cb96729 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:05:00.522978 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.wsgi [None req-e219b374-5765-479e-a306-b4061cb96729 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] HTTP exception thrown: Instance 00b0931a-d15f-4ff6-bfc7-5490869d6892 could not be found. Apr 08 03:05:00.523533 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-e219b374-5765-479e-a306-b4061cb96729 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Returning 404 to user: Instance 00b0931a-d15f-4ff6-bfc7-5490869d6892 could not be found. {{(pid=101271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 03:05:00.524376 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-e219b374-5765-479e-a306-b4061cb96729 tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "DELETE /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 404 len: 111 microversion: 2.1 time: 0.065625 Apr 08 03:05:00.524925 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 530/1077] 10.222.0.23 () {58 vars in 1238 bytes} [Fri Apr 8 03:05:00 2022] DELETE /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 03:05:00.533467 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4eb02536-f8b3-4b5c-a97b-2a6e6cfdaf5f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '>' {{(pid=101272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:05:00.534078 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.compute.api [None req-4eb02536-f8b3-4b5c-a97b-2a6e6cfdaf5f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] [instance: 00b0931a-d15f-4ff6-bfc7-5490869d6892] Fetching instance by UUID {{(pid=101272) get /opt/stack/nova/nova/compute/api.py:2813}} Apr 08 03:05:00.541246 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4eb02536-f8b3-4b5c-a97b-2a6e6cfdaf5f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:05:00.541686 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4eb02536-f8b3-4b5c-a97b-2a6e6cfdaf5f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:05:00.542978 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4eb02536-f8b3-4b5c-a97b-2a6e6cfdaf5f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:05:00.543404 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG oslo_concurrency.lockutils [None req-4eb02536-f8b3-4b5c-a97b-2a6e6cfdaf5f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Lock "e0d9f6c4-1da5-4232-a6ea-53cb1efa9180" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:05:00.601156 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.wsgi [None req-4eb02536-f8b3-4b5c-a97b-2a6e6cfdaf5f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] HTTP exception thrown: Instance 00b0931a-d15f-4ff6-bfc7-5490869d6892 could not be found. Apr 08 03:05:00.601675 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: DEBUG nova.api.openstack.wsgi [None req-4eb02536-f8b3-4b5c-a97b-2a6e6cfdaf5f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Returning 404 to user: Instance 00b0931a-d15f-4ff6-bfc7-5490869d6892 could not be found. {{(pid=101272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 08 03:05:00.602486 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO nova.api.openstack.requestlog [None req-4eb02536-f8b3-4b5c-a97b-2a6e6cfdaf5f tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892" status: 404 len: 111 microversion: 2.1 time: 0.072657 Apr 08 03:05:00.603016 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: [pid: 101272|app: 0|req: 548/1078] 10.222.0.23 () {58 vars in 1235 bytes} [Fri Apr 8 03:05:00 2022] GET /compute/v2.1/servers/00b0931a-d15f-4ff6-bfc7-5490869d6892 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 03:05:02.028485 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: DEBUG nova.api.openstack.wsgi [None req-a1728be9-0238-48a9-9340-e5cced71955e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] Calling method '.version_select at 0x7fbc3848c820>' {{(pid=101271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:05:02.047876 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO nova.api.openstack.requestlog [None req-a1728be9-0238-48a9-9340-e5cced71955e tempest-TestVolumeBootPattern-1101353304 tempest-TestVolumeBootPattern-1101353304-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1326577827" status: 202 len: 0 microversion: 2.1 time: 0.023845 Apr 08 03:05:02.048457 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: [pid: 101271|app: 0|req: 531/1079] 10.222.0.23 () {58 vars in 1262 bytes} [Fri Apr 8 03:05:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1326577827 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 03:05:31.106735 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 03:05:31.107316 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: Fri Apr 8 03:05:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 03:07:24.603743 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 03:07:24.604368 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: Fri Apr 8 03:07:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 03:07:31.716344 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 03:07:31.716845 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: Fri Apr 8 03:07:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 03:07:36.798081 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 03:07:36.798729 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: Fri Apr 8 03:07:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 03:07:41.207150 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 03:07:41.207868 dv-cinder-837051-1-iscsi devstack@n-api.service[101271]: Fri Apr 8 03:07:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 03:07:45.675027 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 03:07:45.675605 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: Fri Apr 8 03:07:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 03:08:51.114642 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 03:08:51.115346 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: Fri Apr 8 03:08:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 03:10:44.611834 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 03:10:44.612460 dv-cinder-837051-1-iscsi devstack@n-api.service[101272]: Fri Apr 8 03:10:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!